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PREFACE 


The  task  of  estimating  the  intentions  of  both  friend  and  adversary 
has  always  been  critical  to  statecraft  and  military  affairs.  The  Chinese 
strategist.  Sun  Tsu,  wrote  long  ago  that  it  is  foreknowledge  which  allows 
the  statesman  or  general  to  achieve  things  beyond  the  reach  of  ordinary 
men. 

But  intention  estimation  has  not  been  an  altogether  respectable 
occupation,  involving  as  it  does  concerted  snooping,  prying,  and  spying  ou 
the  one  hand,  and  the  possibility  of  disasterous  blunders  if  the  wrong 
estimate  is  made,  on  the  other.  This  shady  image  is  often  reinforced  by 
the  remarks  of  journalists  and  even  intelligence  agency  leaders  which 
equate  the  gathering  of  information  on  intentions  with  the  stereotyped 
image  of  the  spy,  cloaked  ana  daggered,  suborning  and  corrupting  informers 
and  insinuating  his  way  into  the  enemy's  secret  councils.  Nor  are 
frequent  reminders  needed  that  it  is  easy  to  go  wrong;  intelligence 
failures  are  uncomfortably  common  now  as  in  the  past.  Since  the  echoes  of 
the  CIA's  scandals  and  abuses  recently  faded  rarely  has  a  month  gone  by 
without  the  appearance  of  an  article  on  the  “op~edH  page  of  a  major 
newspaper  (usually  adorned  uith  an  illustration  of  a  suitably  shady  and 
hooded  figure)  reminding  the  public  that,  while  spy  satellites  may  be  oble 
to  count  the  Russians'  missiles  and  forces,  only  the  old-fashioned  agent, 
out  in  the  Moscow  cold  or  some  other  hostile  capital,  can  inform  uu  what 
our  adversaries  intend  to  do  with  their  forces.  Although  tula  equating  of 
intention  estimation  with  traditional  spying  is  inaccurate,  it  serves  to 
reinforce  the  public  perception  of  intention  estimation  and  intelligence 
gathering  and  analysis  as,  if  not  respectable,  certainly  necessary. 

It  has  not  always  been  so.  As  recently  as  the  1950s  military 
intelligence  analysts  were  explicitly  prohibited  from  estimating  the 
intentions  of  an  adversary  and  required  to  estimate  only  capabilities 
(Steeh,  1980b).  As  the  nature  of  military  and  naval  conflicts  and  the 
political  relations  of  the  world's  nations  grew  mote  complex  and 
swift-paced,  the  requirements  for  intelligence  estimates  of  Intentions 
changed,  Explicit  attention  to  intentions  as  well  as  capabilities  is  now 
required  of  military  analysts  (Stash,  1980b)  and  it  has  been  suggested 
chat  no  intelligence  estimate  is  complete  which  fails  to  give  attention  to 
intentions  and  the  integration  of  intentions  and  capabilities  into  a 
decision-making  analysis  of  the  adversary  (Sullivan,  in  Godson,  1980s 
$1), 

It  is  not  likely  that  a  nation's  intelligence  organisations  can 
suddenly  shift  from  a  philosophy  that  prohibited  intention  estimation  to 
one  that  requires  It  and  just  as  suddenly  begin  getting  first-race 
estimates  of  intentions.  There  are  many  who  believe  the  (Juiced  States  has 
not  recently  had  foresightful  intelligence  estimates  of  intentions  and 
there  are  even  some  who  seem  to  believe  foresight  is  largely  impossible  in 
the  reals  of  intelligence  (see  Stech,  nevertheless  *  there  have 
been  some  remarkable  success  stories  of  intention  estimation  foresight 
(see  Steeh,  I9?9,  and  Slash,  1990b)  and  it  seems  welt  worth  the  effort  to 
try  to  improve  the  peaces*  of  intention  estimation  by  examining  what  is 
required,  how  it  is  done,  the  nature  of  the  problems,  and  the  possible 
solutions. 

An  initial  step  in  this  direction  examined  the  phenomenon  *■( 
intent  ion  estimation,  whether  it  could  or  should  be  done,  hew  failures 
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came  about  and  why  successes  occurred  (see  Stech,  1979).  An  important 
part  of  that  survey  related  the  general  problem  of  Intention  estimation  to 
recent  research  in  cognitive  and  social  psychology  on  human  information 
processing,  the  present  study  takes  this  research  a  step  further  and 
investigates  how  naval  analyses  estiaate  the  peacetime  naval  intentions  of 
the  Soviet  Union  and  how  this  tssk  Is  affected  by  our  human  limits  as 
information  processors  and  probiem-solyers.  In  effect,  we  asked  rad 
attempted  to  answer  the  following  questions:  What  are  the  essential 
processes  of  naval  analysis  of  intentions?  How  do  the  problems  and  limits 
of  human  information  processing  affect  those  processes?  How  do  those 
problems  appear  in  actual  naval  estimates?  How  serious  and  wide-spread 
are  such  problems?  What  might  be  done  to  aid  and  reinforce  human 
information  processing  and  problem-solving  to  possibly  strengthen  naval 
estimates  of  Soviet  intentions? 

this  study  wss  prepared  for  the  Office  of  Naval  Research  under  QNR 
contract  NOOOt4-?8-C~072?  with  Hat-hematica,  Inc.  I  am  deeply  grateful  to 
Commander  Ken  Hull  and  Mr.  J.  R»  Simpson  for  their  advice,  guidance,  and 
support  in  this  research  effort.  I  am  also  greatly  indebted  to  many 
colleagues,  friends,  and  advisors  who  guided  me  to  the  hearts  of  the 
intention  estimation  and  human  cognition  problems,  to  the  extent  that  1 
have  aimed  in  the  right  directions,  they  are  due  the  credit.  If  I  have 
missed  the  target,  I  am  to  blame.  Dr*.  Richard  Hetts,  Carry  Brewer, 
Judith  A,  D«ly,  Robyn  Dawes,  Baruch  Fisr.hboff ,  Michael  Handel,  Edward 
Junes,  and  Berry  Turner,  and  Major  Generals  Doyle  Larson  and  Schlooo  Gazic 
provided  me  valuable  comments  on  intention  estimation,  cognition,  and 
intelligence  analysis.  Hr.  Richards  Hcuer  shared  with  me  his  many 
articles  and  thoughts  on  the  psychological  elements  of  intelligence 
analysis.  Ms.  Cynthia  Or*  bo  provided  many  Insights  into  indicators  and 
the  problem  of  warning  an?*  allowed  me  to  delve  into  her  extensive  writings 
on  these  subjects.  The  following  intelligence  veterans  and  scholars 
shared  their  experiences  and  reactions  to  my  efforts:  Oorwln  Cartwright, 
Ray  Cline,  William  S.  Colby,  Matthew  Gallagher,  Raymond  Csrchoff,  Arthur 
Hulnicfc,  Klauc  Kanrr,  William  Kopiowlte,  James  McConnell,  Michael 
HccCwire,  Dan  Maxim,  waiter  Rforttfeeimer,  Sayre  Stevens,  and  Barton 
Whaley,  Ha.  Alma  Mali  ones  again  rose  above  and  beyond  the  call  of  duty 
and  produced  the  typescript,  tables  and  figures,  t  m  also  graceful  to  Ms. 
Sans  Davis  for  her  assistance. 

Host  of  the  prefatory  quotation#  used  in  this  study  can  be  found 
In  Bartlett's  Quotations  or  any  similar  guide.  .  Some  of  the  sore 
lighthearted  aphorisms  come  fn«  A*  Bloch,  Morphy's  Law:  Book  jl  (1980 
to«  Angeles:  Pricer,  Steam,  Sloan©)  and  P,  Dickson, '“the  ’  Q£  fl'clel  Rules 
f  1978,  New  York:  Dsiaeort#  Press).  • 

The  views  expressed  here  ire  those  of  the  author  and  do  not 
teoeasarily  represent  view*  held  by  Th#  Office  of  Naval  Research, 
Mathematic*,  Inc.,  or  KATHIE&i,  Inc. 
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CHAPTER  l.  INTRODUCTION  AND  OVERVIEW 


Before  a  war  military  science  seems  like  a  real  science, 
like  astronomy,  but  after  a  war  it  seems  acre  like 
astrology, 

Rebecca  West 


WHAT  THIS  STUDY  DOES 

This  report  examines  a  sample  of  publicly  available  estimates  of 
tits  peacetime  naval  intentions  of  the  Soviet  Union  written  by  experts  on 
the  Soviet  Navy.  It  does  not  examine  the  Soviet  Navy  itself,  except 
through  these  sampled  estimates,  because  the  objective  of  this  study  is  to 
determine  how  such  estimates  are  made,  where  the  estimation  methods  might 
be  weak  Cor  particularly  strung),  and  to  make  some  recommend? t ions  for  the 
authors  and  users  of  such  estimates.  Decause  of  this  focus  on  methods, 
the  images  of  the  Soviet  Navy  conveyed  here  are  apt  to  be  misleading  — 
the  reader  should  consult  the  original  estimates  for  more  faithful  images. 
But  the  reader  seeking  a  means  by  which  to  weigh  and  judge  conflicting 
estimates,  and  the  estimator  seeking  to  improve  the  craft,  may  find  some 
helpful  analysis  here. 

Evaluations  of  the  methods  of  estimators  have  been  conducted 
before  and  these  prior  efforts  have  influenced  the  approach  taken  here. 
For  example,  George  (19S9)  assessed  the  methods  and  predictive  accuracy  of 
propaganda  analysts  In  World  War  II*  Here  recently  A&cfrer  (1918)  assessed 
the  methods  and  accuracy  of  forecasters  predicting  trends  in  papulation » 
national  economic  data,  energy,  transportation,  and  technology*  Cockle 
C19?B),  Lee  (19??),  and  Holgaan  (1980)  have  assessed  the  methods  and 
accuracy  of  CIA  estimates  of  Soviet  defense  expenditures.  CT  Leary  and 
Coplio  (19?$)  compared  the  methods  of  State  Department  intelligence 
analysts  to  Quantitative  techniques  addressed  to  the  same  issues.  Albert 
WeHlstettec  (if Ha,  fe,  o;  19?$a,  fe)  evaluated  the  accuracy  of  W»§,  Defense 
Department  estimates  of  Soviet  strategic  capability  and  eritieised  what  he 
s a«  as  the  fallacious  basic  assumptions  of  the  estimators.  In  addition, 
as  is  dene  in  this  study,  previous  writers  have  recommended  greater  use  of 
systematic,  quantitative,  or  mathematical  aids  to  IsielHpsee  and  defense 
analysis  (**$.,  Hauer,  19?$  i  O'Leary  and  Ceeiio,  19H;  Sassy,  1968). 

estimation _  Nethedi 

■  What  is  the  point  of  assessing  the  methods  &f  estimators  or  their 
processes  of  judgment,  rather  than  just  assessing  the  estimates  and 
■  judgments  themselves?  This  it  a  reasanab i@  question  but  it  reflects  a 
belief  that  somehow  cite  facts  speak  fur  themselves  and  that  the  methods  of 
estimators  have  easily  an  unimpoftant  impact  on  these  estimates  (Dart huff., 
199$)*  the  idea  that  intelligence  can  somehow  emerge  fro*  raw  facts, 
untouched  fey  the  sullying  finger*  of  method,  is  part  • .  what  Washerman 
(198$)  labeled  “induct sonism”  and  “naive  realism”  **•  belief*  that  all  the 
facts  need  to  turn  into  truth  is  unbiased  mbaeruaftieo,  and  that  the 
“unvarnished”  fact*  will  admit  only  ene  interpretation. 

Seth  the  analysis  of  intelligence  production,  and  the  study  of 
human  judgment  in  general,  have  demonstrated  that  the  methods  (fee  they 
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intelligence  analysis  methods,  or  4«***  the  usual  patterns  of  everyday 
thought)  influence  the  judgments  (see  e.g»,  Stech,  1979;  Eiohorn  and 
Hogarth t  1981).  the  et'fecf  of  such  a  seemingly  trivial  methodological 
issue  as  hot*  a  question  is  asked  can  have  a  Major  influence  on  the  answer. 
A  v*n**l  review  of  research  on  how  people  make  decisions  (Elnhorn  and 
1981  >  argue*  that  (emphasis  added): 

.  *  «•  »  most  important  empirical  results  in  the  period 
w.ivr  ie7U*?  have  shown  the  sensitivity  of  judgment  and 
choice  to  seeauagiy  minor  changes  io  tasks  (p.  U)  - 

If  minor,  easily-overlooked  aspects  of  judgment  tasks  can 
significantly  change  judgments,  even  though  no  data  are  changed,  then  it 
seems  worthwhile  to  examine  the  estimation  task  and  assess  which  details 
of  method  might  he  reducing  the  reliability  or  validity  of  estimates.  A 
recent  conceptual  paper  m  estimates  based  on  uncertain  data  (Howell  and 
Soroett,  1978:  46-47)  makes  the  related  point: 

Man  la  both  an  abU?  “intuitive  statistician*  and  a  pragmatic 
rule  maker  depending  on  what  He  is  asked  to  do  with 
uncertain  information  *  *  .  (this)  implies  that  description 
of  task  parameters  deserves  more  attention  than  it  has  thus 
far  received. 

this  study  is  an  in-depth  examination  of  the  ‘'task  parameters'*  of  the 
analyst  estimating  the  peacetime  naval  iatenti.ua*  of  the  Soviet  Mavy. 

focus  on  Intentions 

.-swrnwr ii «a— a »im»amaeuvj«a  lajm^atauMei 

Always  pray  that  your  opposition  is  wicked*  in  wickedness  •• 
there  is  *  strong  straip  tew***  rationality.'  'fH«?#fore 
there  is  always  the  possibility*  la  theory,  of  handling  the 
■  ■  wicked  by  eutthiaking  them. 

"I«d«i  3#  Uwy,  J*.r  19H' 

Vhr  look  at  estimates  of  t4tttftttesst  thif.-is  not  an  easy  question 
to  mm****,  and  it  conflicts  with  a  %m$  tradition  *h*s  has  dictated  that 
militity.  Intali Igence  should  estimate  capabilities*  not  intentions- («*§** 
■see*  stecH*  Iftir,  Oarthotf*  197§)S  it  ten  be  Mfumd  that  Intentions  must 
be  si $a|-with  capabilities  ftartheff,  !$'>§)*  that  Ihttnt isos  can 

*nd  skew id  be.  estimated  (stock,  1179)*  end  that  military  dactflht  has 
evolved  from  tnt  traditional  view  to  one  which  requires  estimates  of 
intentions  (Sterh*  IfdQa).  there  is  alt#  the  psaMasi  this  estimates  which 
appear  to  duel  only -with  capabilities  often  cenceei.  (not  intentionally)  an 
implicit  estimate  of  intent  tone,  r&laf  arcing  the  need  for  methods  which 
akeeae  lotentioo  estimates.  : 

focus  on  kissae  , 

If  on*  views  his  problem  closely  enough  be  will  recogaixe 
himself  is  pert  of  the  problem. 

Sueherv's  Axiom 

£ 


Uhy  fceu*  on  estimation  biases,  weaknesses  ,  anti  fallacies?  The 
search  for  methodological  weaknesses  is  us  old  as  science*  The  first 
scientific  encyclopedia,  Roger  Queon's  ftpns  Majus,  delivered  to  Pope 
Cleaent  IV  tn  126$,  devoted  the  first  of  its  seven  major  par ;$  to  human 
fallings  and  the If  causes.  Classic  examples  of  analyses  of  faults  are 
Thomas  Hobbes'  leviathan  and  Behemoth ,  narrations  of  the  loll* os  and 
shortcomings  of  man.  Swift's  Col  liver's  Travels  satirized  post  tics l 
faults;  Voltaire's  Candida,  social  flaws;  Sent  Han's  hook  of  Pa  1  hr  i  es  , 
historical  and  economic  errors.  This  report  makes  "no  -pretense  •  •»  loin 
these  ranks,  bat  they  serve  to  illustrate  a  warning.  If  Saeon's  ,  n  was 
excessively  sinful,  Hobbes*  man  a  brutish  beast,  Swift's  men  vnin^ovious 
knaves,  and  Voltaire's  mar  i  ignorant  naif,  the  pitfall  of  gh»  *-esent 
study  is  that  it  aipst  be  read  as  characterising  the  naval  ./..t  as  a 
clever  but  so  If ’•befuddled  fool.  This  is  so  far  (rota  the  aim  .  this  study 
that  Its  opposite  is  far  closer  to  the  truth:  |r  *p  oy  opinion 
(subjective  and  biased  perhaps)  that  naval  analysts  are  >  careful  *nd 
sophisticated  that  any  problems  remaining  with  their  estimates  are 
extremely  subtle  and  nonobvious. 

It  is  a  very  great  mistake,  a  mistake  gene  has  and  others  have 
made,  to  believe  that  errors  of  logie  or  reasoning,  fallacies  of  method, 
or  failures  of  forecasting  accuracy  are  prion  facie  evidence  that  the 
estimate  is  false  in  ail  respects  and  utterly  useless.  It  is  for  this 
very  reason,  the  need  for  analysis  which  can  chop  logic  into 
the  weak  and  strong  parts,  that  this  study  was  undertaken,  if  naval 
analysis  were  fools,  this  study  would  fee  unnecessary,  and  a'  schoolboy 
could  do  for  naval  analysis  what  hacon  and  his  hairy  have  done  for  other 
reals*®.  It  is  because  naval  and  intelligence  analysts  tend  to  do  their 
work  so  welt  that  careful  assessments  of  their  methods  are  needed  to 
determine  any  subtle  and  eoeobviuu®  biases  that  ®ay  remain. 

llHlg  intent  Ions 

ifhy  focus  on  estimates  of  peacetime  Soviet  naval  intentions?  Is 
It  really  necessary  to  assess  f owlet  geiget Ime  naval  intention?  should 
not  the  naval  analyst  gontentrate  W'lis*_w&rsl*®8  intent  ions  of  the  Soviet 
ifavy?  Wp  until  abmut  lt&§,  it  was  ^uits  likely  that  any  »ajM  cant  act 
.between  the  or  lies  tern  fleets  and  the  Soviet  5^vy  w^uid  oo.eut'  during 
a  war*  §in@e  however,  #oufeet:#  between  the  Ssviet  and  «rn 
navies  are  mure  frequent  and  esteusive  and  are  apt  te>  t%«u»  in  crisis 
situbtlsns  that  &§ul4  lead  to  war.  hew  the  navies'  of  the  lies,  and  the 
Soviet  ffmisn  cnnilwcf  thgmsaivvn  in  these  feagetima  and  crises  e«s§unters 
has  a  gonsiderabie  impact  an  the  ilkeilhn§4  that  lush  crises  might  evolve 
into  war.  It  is  useful  to  review  the  origins  nS  this  interest  in  the 

peacetime  Soviet  5£uvy. 

Origins.  Intense  Western  vancern  over  the  forward  deployments  and 
fleet  nodefnisaition  of  the  Soviet  $awy  began  $n  its?,  v?*gn  a  Susaian  *blut 
water*  capability  had  Seeaae  a  aredibie  reality.  In  l$h?  the  soviets 
iaunched  the  first  T^eiass  nuclear  ballistic  missile  fubmarlnee  f§S3^s), 
with  lb  tubes  for  i  j@SM*awt  ita  i  min  bait  intig  missiles,  gfce  first 
irasbya’nsiass  helicopter  entfSef  became  eperotiouai ,  Carrying  the  fit 
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Soviet  naval  avaiation  units  afloat.  In  May  and  June,  1967  ,  during  the 
Arab-Israeli  War,  the  Soviets  deployed  two  anticarrier  task  forces  to  the 
Eastern  Mediterranean,  matching  the  two  U.S.  carrier  task  groups,  marking 
the  beginning  of  an  expanded  Soviet  permanent  presence  in  the 
Mediterranean.  Between  1965  and  1976  Soviet  Mediterranean  warship 
operating  days  quadrupled  from  4  500  to  18,600,  with  the  largest  jump 
coming  in  1967.  In  October  1967,  during  the  Arab-Israeli  War,  Egyptian 
forces  manning  a  Soviet-built  Komar-class  missile  patrol  boat  sunk  the 
Israeli  destroyer  Eilat  with  a  surface-to-surface  Styx  cruise  missile. 

These  events  had  an  immediate  and  continuing  impact  on  Western 
appreciations  of  the  goals  of  the  Soviet  Navy.  They  also  seemed  to  many 
analysts  to  reflect  a  sharp  change  in  Soviet  intentions  and  led  to  various 
interpretations  (as  we  shall  show  in  Chapter  3)  of  why  the  Soviets  had 
altered  their  naval  policies,  of  what  they  could  and  would  do  with  their 
new  forces  and  forward  deployments,  of  the  risks  the  Soviets  might  run  in 
these  activities,  and  how  they  would  employ  these  capabilities  in 
peacetime  and  crises.  Furthermore,  a  variety  of  methods  were  developed  by 
analysts  and  employed  to  investigate  these  intention  questions. 

Despite  the  differences  of  opinion  on  long-run  Soviet  naval 
intentions,  there  was  considerable  agreement  on  the  short-run  significance 
of  these  events  among  Western  observers.  For  example,  the  Y-class/SS-N-6 
submarine,  roughly  comparable  to  the  U.S.  Ethan  Allan-class/Polaris  SSBNs, 
allowed  the  Soviets  to  begin  closing  the  margin  in  offensive  sea-based 
strategic  missiles  which  the  United  States  had  enjoyed  from  1961  to  1970. 

The  Moskva-class  represented  a  significant  departure  from  a  Soviet 
policy  dating  from  the  post-Stalin  era  which  deprecated  the  survivability 
and  utility  of  aircraft  carriers  in  nuclear  war  and  stressed  the 
superiority  of  the  Soviet  anticarrier  defensive  task  forces.  While  some 
Western  analysts  quickly  pointed  out  that  "the  Soviets  (never)  questioned 
the  value  of  diversified  carrier  capabilities  in  a  variety  of  situations 
short  of  (nuclear)  war"  (Wolfe,  1972:  37),  others  (e.g.,  Herrick,  1968; 
Smolansky,  1977)  note  that  the  Soviets  have  still  to  launch  their  first 
fleet  aircraft  carrier.  Still  others  have  noted  the  Soviets  act  as  if 
their  anticarrier  warfare  task  forces  are  a  significant  hindrance  on 
Western  use  of  carriers  in  crises  (Dismukes  and  McConnell,  1979:  22), 
implying  a  continued  vulnerability  of  carriers.  Analysts  agree  that  the 
new  Soviet  naval  aviation  capability  poses  ?  new  dimension  to  the  problem 
of  estimating  Soviet  naval  capabilities  and  intentions,  but  disagree  on 
just  what  these  developments  portend. 

The  expanded  Soviet  out-of-area  deployments  to  the  East 
Mediterranean  foreshadowed  the  commencement  in  1968  of  regular  deployments 
to  the  Indian-  Ocean,  and  ended  what  McConnell  and  Dismukes  (1979:  16) 
noted  was  "a  full  decade  (1957-1967)  (in  which)  no  recognised  instances  of 
Soviet  coercive  diplomacy  based  on  forces  in  the  forward  area  occurred  " 
The  Eilat  sinking  demonstrated  that  conventional  gun-armed  ships  could  be 
outranged  and  sunk  by  much  smaller  missile-armed  craft.  Wolfe  (1972: 
23-24)  asserts  that  this  event  "served  perhaps  more  than  anything  else  to 
sensitize  Western  naval  circles  to  the  threat  implicit  in  the  Soviet 
Navy's  adoption  of  anti-ship  missile  armament  .  .  .  the  Soviet  potential 
to  challenge  Western  surface  supremacy  came  to  be  taken  far  more  seriously 
than  hitherto."  Analysts  agree  that  these  developments  are  perceived  in 
the  West  as  "coercive  diplomacy"  and  a  potential  challenge  to  Western 
surface  supremacy,  but  they  disagree  on  how  realistic  these  perceptions 


4 


are  and  whether  these  are  the  reasons  the  Soviets  have  undertaken  forward 
deployment  and  adapted  missile  and  rocket  technology  to  naval  weaponry. 

The  combination  of  these  events  made  several  conclusions  about 
Soviet  naval  intentions  fairly  widespread.  The  explansion  of  the  Soviet 
strategic  offensive  capability  represented  in  the  Y-claas  program,  it  was 
reasoned,  would  "draw"  other  Soviet  units  into  blue  water  areas, 
especially  ASW  forces  to  protect  the  Y-class  boats  from  Western 
hunter-killer  submarine  and  surface  forces.  The  Moskva -class  ASW 
heliocopter  carriers  could  serve  this  function,  could  operate  against  U.S. 
Polaris  boats,  or  could  be  adapted  to  other  roles,  for  example,  as  a 
vertical  envelopment  platform  to  support  amphibious  landing  operations. 
Any  of  these  missions  could  be  expected  to  draw  Soviet  forces  out  of  home 
waters  into  areas  previously  dominated  exclusively  by  Western  navies.  The 
equipping  of  Soviet  surface  and  submarine  units  with  long-range 
surface-to-surface  missiles  gave  the  Soviet  blue  water  task  forces  a 
credible  capability  previously  lacking  against  Western  forces  that  were 
out  of  range  of  Soviet  air  power. 

The  Soviet  Navy,  without  increasing  its  forces  (indeed  in  some 
respects,  e.g.,  cruisers  and  destroyers,  with  fewer  forces)  had  been 
transformed,  in  the  eyes  of  the  West,  by  its  construction  program  and  its 
expanded  deployments,  from  a  coastal  auxiliary,  into  a  potent  competitor 
of  the  West  on  the  high  seas. 

Furthermore,  the  Western  perception  of  an  upswing  of  Soviet 
ct  ;rcive  diplomacy"  (McConnell  and  Dismukes,  1979;  14;  Dismukes  and 
McConnell,  1979)  using  these  transformed  cauabilities  was  compared  to 
pronouncements  (made  in  1967)  by  Admiral  Sergey  Gorshkov, 
Commander-in-chief  of  the  Soviet  Navy,  that  in  the  mia-19503  Moscow  had 
embarked  on  a  new  naval  policy  "aimed  at  building  up  capabilities  not  only 
for  nuclear  (world)  wars,  but  also  for  conventional  (local)  wars  and  the 
'protection  of  state  interests*  abroad  in  peacetime"  (McConnell  and 
Dismukes,  1979;  15).  The  fruits  of  this  new  policy,  the  naval  units  which 
appeared  in  the  late  1960s,  were  seemingly  put  to  use  projecting  Soviet 
power  and  "protecting  Soviet  state  interests,"  beginning  in  1967  and 
continuing  up  to  the  present. 

In  addition  to  this  supposition  that  t\ •  Soviets  have 
intentionally  designed  their  forces  for  traditional  diplomatic  power 
projection  and  the  capability  to  influence  or  engage  in  limited 
conventional  wars  (as  well  as  to  undertake  other  missions,  e.g.,  strategic 
offence  or  defense),  Western  analysts  have  reached  other  conclusions  that 
make  the  Soviets*  intentions  for  these  forces  of  great  interest.  These 
capabilities  make  Soviet  involvement  in  Third  World  crises  more  likely  and 
more  frequent  than  would  superpower  crises  between  the  USSR  and  the  United 
States  alone.  Similarly,  the  United  States,  as  a  consequence  of  Soviet 
inducement,  is  more  likely  u*  become  involved  in  smaller  crises  than  in 
bigger  ones  which  force  it- to  directly  confront  the  Soviets,  this  strong 
and  increasing  possibility  that  local  crises  .*ay  draw  together  both 
superpowers  (as  happened  in  the  Middle  East  in  1956,  1967,  and  1973,  and 
in  the  Indian  Ocean  in  1971)  makes  any  Soviet  intention  regarding  local 
involvements,  power  projection,  coercive  diplomacy,  or  conventional 
capabilities  of  interest  to  the  United  States,  both  in  the  political  sense 
that  Soviet  Influence  may  thereby  be  expanding,  and  in  the  conventional 
and  strategic  military  sense  because  U  §»  military  forces  (especially 
naval  ones)  may  become  enmeshed  in  conflict  with  Soviet  units.  In 


addition,  the  Soviet  Navy's  expanded  forward  presence  increases  its  daily 
interaction  with  Western  fleets  since  both  sides  detail  units  to  observe 
each  other's  exercises  and  operations*  In  the  past,  harrassnents  were  not 
uncommon.  Although  the  1972  U.S. -Soviet  naval  agreement  to  prevent  naval 
incidents  reduced  the  dangers  of  accidents  and  conflict  by  mishap,  the 
frequent  intermingling  of  forces  in  the  various  areas  where  large 
deployments  overlap  (the  Mediterranean,  Norwegian  Sea,  the  Baltic  and 
North  Seas)  made  Interactions  with  the  Soviet  Navy  common  and  unavoidable 
as  Soviet  out-of-area  deployments  increased.  Thus,  with  respect  to  Soviet 
world  influence,  to  strategic  deterrence,  to  Third  World  crises,  and  "o 
daily  peacetime  noncrises  contacts,  the  Soviet  peacetime  intentions  for 
its  naval  forces  are  of  great  military  and  political  significance  to  the 
West. 

WHAT  this  study  covers 

This  study  examines  in  detail  the  methods  of  naval  analysts  as 
these  relate  to  different  steps  of  intention  estimation.  Although  the 
main  purpose  of  this  study  is  to  assess  methods,  some  analysis  of  the 
characteristics  of  intention  estimates  is  necessary.  In  Chapter  2  the 
various  means  of  prediction  are  described  along  with  their  requirements, 
the  issues  of  specificity  and  precision  are  discussed,  and  the  possibility 
of  assessing  the  complexity  and  logic  of  estimates  is  suggested. 

In  Chapter  3  nine  cases  are  reviewed  which  reveal  differences  in 
analysts'  conclusions  on  important  Issues  regarding  the  peacetime 
intentions  of  the  Soviet  Navy,  These  cases  provide  a  mini-review  of  the 
methods  and  conclusions  of  many  of  the  naval  analysts  in  our  sample, 
provide  a  short  survey  of  some  critical  issues,  and  introduce  thu  nonnaval 
analyst  to  some  important  controversies.  The  main  purpose  of  this 
chapter,  however,  is  to  demonstrate  the  range  of  possible  error  in  current 
naval  estt mates. 

Chapter  4  contains  the  e&io  analysis  of  this  study,  a  dissection 
of  eatimation  into  component  parts  and  an  assessment  of  these  parts  from 
the  perspective  of  cognitive  psychology,  logic,  and  information 
processing.  This  assessment  is  independent  of  the  content  of  the 
estimates  and  aims  at  «  deeper  understanding  of  the  estimation  process. 

Chapter  5  provides  a  variety  of  recommendations  for  strengthening 
the  estimation  proses*  and  offsetting  many  of  the  information  processing 
problems  noted  in  Chapter  3,  Many  of  the  methods  recommended  have  already 
been  tried  or  tested  in  other  areas  of  intelligence  estimation. 

Sources 


The  analysis  In  this  study  is  based  on  a  sample  of  naval  estimates 
widely  available  to  the  public*  These  sources  are  Hated  is  Table  1. 
(Table  1  also  notes  the  abbreviations  used  in  this  study  for  the  more 
frequently  used  volumes  In  lieu  of  the  regular  referencing  format.) 

Selection _ method *  These  estimates  were  selected  in  the  following 
manner,  """*  li t erature  survey  was  made  of  recent  papers  directly  or 
peripherally  related  to  the  peacetime  intentions  of  the  Soviet  Navy.  Thin 
lad  to  a  list  of  twenty-plus  volumes  and  papers.  Many  of  these  overlapped 
and  eliminating  duplications  led  to  a  list  of  thirteen  titles,  very 
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Table  1.  Sources  of  Naval  Estimates  Assessed  and  Consulted.  (Abbreviations 
used  In  this  study  in  parentheses.) 


Estimates  Assessed: 

BLECHMAN,  B.  (1973)  The  Changing  Soviet  Navy.  Washington,  D.C.:  The 
Brookings  Institution. 

BOOTH,  K.  (1974)  The  Military  Instrument  in  Soviet  Foreign  Policy  1917-1972. 
London:  RUSI. 

DISMUKES,  B.  and  J.  McCONNELL  (eds.)  (1979)  Soviet  Naval  Diplomacy.  New 
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similar  to  that  shown  in  Table  1.  This  tentative  list  of  titles  was  shown 
to  two  leading  figures  in  naval  analysis,  Michael  MccGwire  of  Dalhousie 
University  and  James  McConnell  of  the  Center  for  Naval  Analysis  (CNA) ,  as 
well  as  to  technical  officers  in  the  Office  of  Naval  Research.  The  list 
was  also  discussed  informally  ? 1th  naval  analysts  at  CNA,  CIA,  and  in  DoD. 
In  all  cases  we  asked  if  there  were  titles  or  papers  not  on  the  list  that 
should  be,  or  titles  on  the  list  that  could  be  dropped.  The  resulting 
recommendations  led  us  to  add  several  papers  and  to  consult,  but  not 
analyze  several  more. 

Types.  It  is  not  likely  that  this  list  of  estimates  is  highly 
representative  of  any  one  school  or  type  of  naval  analysis.  Both 
quantitative  and  qualitative  papers  from  a  variety  of  disciplines  other 
than  naval  analysis  are  included.  Analysts  from  government  and  academia 
are  also  included.  Not  all  the  papers  in  these  collections  received  equal 
attention;  the  major  emphasis  was  put  on  those  moat  clearly  related  to 
peacetime  naval  intentions. 

WHAT  THIS  STUDY  DOES  NOT  COVER 

Several  important  issues  regarding  the  methods  of  naval  analysts 
are  not  treated  in  this  study.  These  are  ail  important  dimensions  of 
naval  analysis  methodology  and  deserve  detailed  assessment,  but  such 
assessments  require  resources  that  exceed  those  of  this  study. 

Accuracy 


We  do  not  attempt  to  comment  extensively  on  the  accuracy  of  the 
content  of  the  sampled  estimates  of  Soviet  intentions.  While  it  is 
possible  to  demonstrate  occasional  instances  where  an  analyst  has  been 
proved  right  or  wrong  by  events,  in  general,  naval  estimates  are  too  vague 
or  Imprecise  to  allow  us  to  assemble  a  useful  track  record  of  accuracy 
In  many  cases  accuracy  could  only  be  appraised  by  resorting  to  classified 
material .  A  partial  record  of  “hits”  and  “misses1*  would  be  highly 
misleading.  Some  analysts,  for  example,  may  handle  only  the  hardest 
topics  (in  the  sense  of  predictions),  end  have  a  large  number  of  obvious 
misses  and  an  unmeasurable  number  of  hits.  It  would  be  inappropriate  to 
compare  these  analysts  with  those  predicting  other  issues* 

Social  Effects 


Each  estimate  la  assumed  in  this  study  to  be  the  product  of  its 
authors.  This  assumption  neglects  the  social  facts  that  shape  the 
planning,  conduct,  and  drafting  of  Intelligence  products.  Analysts  are 
not  immune  from  social  pressures  or  influences  during  these  stages,  and 
these  social  effects  can  perhaps  be  detected  in  the  finished  estimative 
products.  To  assess  this  social  influence  adequately,  however,  would 
require  either  a  participant-observer  or  direct  obaervation  of  the 
analysts  at  work.  These  are  both  feasible  msthoda  but  were  impracticable 
in  the  present  study* 
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Organizational  Effects 


This  study  makes  no  effort  to  determine  whether  naval  estimates 
tend  to  reflect  the  organizational  interests  of  the  institutions  that 
sponsor  them.  Lacking  any  clear  metric  for  prediction  accuracy  we  cannot 
meaningfully  determine  if  analysts  for  one  organization  typically  over-  or 
underestimate  the  Soviet  Navy  Nor  can  we  meaningfully  assess  what  an 
organizational  bias  might  be  through  simply  examining  the  estimates  of 
analysts  from  that  organization.  Even  if  they  all  "sang  the  same  song," 
it  could  simply  be  that  they  were  all  accurately  perceiving  the  same  data. 
It  is  also  possible  that  analysts  in  an  organization  cane  to  the  same 
conclusions  because  of  information  processing  biases,  that  is,  the 
organization  may  predispose  the  analysts  to  use  certain  methods  (not  to 
reach  certain  conclusions),  these  methods  may  tend  to  bias  Information 
processing  in  certain  directions,  and  analysts  come  to  share  conclusions 
because  they  share  methods.  While  these  are  intriguing  possibilities, 
they  could  not  be  addressed  here. 

Motivational  Effects 


The  common  understanding  of  the  term  "bias"  gives  it  a  motivation 
meanings  "I  am  biased  toward  a  particular  viewpoint  because  that  is  how  I 
wont  things  to  come  out."  An  alternative  to  this  "wishful  thinking" 
definition  is  one  which  sees  bias  as  serving  instrumental  ends:  "I  am 
biased  toward  a  particular  viewpoint  because  it  will  suit  my  ends  to  have 
that  v'ew  accepted- “ 

Note  that  these  meanings  do  not  imply  any  conscious  deceptive 
intent  on  the  part  of  the  analyst.  Deception  might  be  a  hoax,  or  a  lie, 
but  it  cannot  be  a  bias.  These  motivational  biases  are  unconscious 
self-deceptions. 

This  study  does  not  deal  with  motivational  biases  for  two  reasons; 
philosophical  and  psychological.  A  motivational  bias  implies  that  the 
analyst  tends  to  think  (is  biased)  toward  a  conclusion  chat  somehow  he  or 
she  could  know  is  not  accurate.  It  implies  that  the  analyst  could  control 
the  effects  of  motivations  on  perceptions  and  thinking  if  he  tried  hard 
enough  or  struggled  to  remain  objective.  In  effect,  motive  one  (wishful 
fulfillment)  struggles  with  motive  two  (objectivity)  and  if  it  wins,  the 
analyst  is  biased  because  motive  one  then  struggles  with  perception  and 
again  wins.  This  logic  Introduces  several  layers  of  regress  from  what  can 
be  meaningfully  observed  and  measured. 

Psychologically  we  can  demonstrate  several  means  by  which  bias  in 
analysis  can  occur  simply  through  information  processing  mechanisms 
(Chapter  4)  without  recourse  to  motivational  mechanisms.  These  biases  are 
strong  and  pervasive,  and  can  be  assessed  directly.  While  we  cannot  deny 
that  motivational  biases  exist,  it  seemed  more  profitable  to  assess  the 
more  accessible  cognitive  biases.  Since  these  are  less  intuitively 
obvious  than  motivational  biases,  they  are  probably  more  insidious  and 
difficult  to  guard  against.  In  fact,  most  people  are  unwilling  to  accept 
that,  without  explicit  help,  they  cannot  logically  think  through  complex 
problems  > 

Political  Effects 


This  study  does  not  address  the  charge  that  intelligence  estimates 
ore  often  wrong  because  they  are  political  creations  with  little  relation 


to  reality.  While  some  estimates  have  sufficient  policy  import  to  become 
political  footballs  (e.g.,  the  Team  A-Teata  B  episode  regarding  Soviet 
strategic  intentions  in  the  old-  to  Iate-I9?0s) ,  most  estimates  probably 
never  reach  important  politicians  and  are  protected  from  political 
pressures  by  sheer  neglect.  Political  pressures  may  be  brought  to  bear  on 
any  forecasting  or  estimative  effort  that  has  potential  policy  relevance, 
but  in  a  pluralistic  society  with  a  highly  decentralized  bureaucracy,  as 
in  the  United  States,  a  variety  of  differing  political  viewpoints  are 
likely  to  be  represented  in  any  pressures  that  are  brought  to  bear. 

This  does  not  mean  that  political  competition  can  substitute  for 
estimation  objectivity.  The  interaction  of  these  two  tendencies  is  an 
Important  component  of  the  analysis  of  intelligence  production  but  beyond 
the  scope  and  competence  of  this  study. 

HOW  TO  USE  THIS  STUDY 

The  following  remarks  suggest  how  various  readers  might  peruse 
this  study  other  than  reading  it  cover  to  cover. 

Naval  Analysts 


Chapter  4  describes  a  variety  of  nonobvious  problems  with 
estimation  logic  and  narrative  logic.  The  examples  demonstrate  how  these 
information  processing  problems  can  occur  in  naval  analysis.  Naval 
analysts  may  find  reasons  to  reflect  on  their  own  methods  in  this  chapter, 
and  many  new  ways  to  question  and  challenge  the  conclusions  of  rival 
analysts.  This  chapter  provides  an  objective  means  of  assessing  the 
methodological  validity  and  logic,  and  the  cognitive  process,  of  intention 
estimation,  independent  of  data  or  conclusions. 

Chapter  5  reviews  a  variety  of  methods  and  techniques  which  have 
been  tried  in  other  intelligence  fields  and  which  might  improve  naval 
analysis  and  intention  estimation.  While  not  a  handbook  or  cookbook  of 
methods,  it  suggests  ideas  for  new  methods  in  naval  estimation. 

Chapter  3  briefly  reviews  some  major  controversies  among  naval 
analysts  regarding  the  future  peacetime  intentions  of  the  Soviet  Navy. 

Soviet  Analysts 

tmmm 

Chapter  3  briefly  summarises  differing  opinions  on  the  future 
directions  of  the  Soviet  Navy,  These  open  questions  suggest  some 
important  gaps  in  our  understanding  of  the  past,  present,  and  future  of 
this  increasingly  important  Soviet  institution  and  the  need  for  eonnavai 
perspectives. 

Chapter  A  suggests  how  some  of  these  differences  of  opinion  arise 
from  the  way  analysts  process  information  on  the  Soviet  Navy,  These 
biases  may  affect  any  analysis*  They  also  suggest  some  possible 
directions  to  go  for  remedies,  these  directions  are  outlined  in  Chapter 
5. 

Consumers  of  Naval  Estimate* 

The  problematic  characteristics  of  current  naval  estimates 
(Chapter  2)  make  them  leas  useful  then  more  precise,  specific,  and 
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predictive  estimates  would  be.  But  precision  and  predictiveness  must  be 
traded  off  for  uncertainty.  At  present,  uncertainty  is  not  handled 
explicitly  or  quantitatively  by  naval  analysts.  They  are  well  aware  of 
uncertainty  but  seea  not  to  know  what  to  do  with  it  except  acknowledge  it 
and  skirt  it.  This  leads  to  many  biases  in  the  processing  of  uncertain 
information  (Chapter  A).  Naval  analysts,  like  most  people,  seea  largely 
unaware  of  these  biases.  Problems  with  the  content  of  estimates  may 
actually  be  due  to  the  methods  used  to  process  information  rather  than  to 
problems  with  the  analysts'  data,  perspective,  or  conclusions. 

While  a  range  of  analytic  opinion  probably  exists  on  any  subject 
of  policy  importance,  this  range  itself  can  be  an  important  gauge  of 
analytic  error  and  uncertainty  (Chapter  3),  and  a  sign  that  (i)  the 
differences  arc  due  to  methods  as  well  as  opinions,  (2)  other  methods  may 
be  useful  (Chapter  5). 

Cognitive  Psychologists 

Examples  of  cognitive  and  information  processing  biases  are 
usually  the  product  of  laboratory  demonstrations.  Many  "real  world" 
examples  from  naval  analysis  are  presented  and  assessed  in  Chapter  4, 
Chapter  5  suggests  many  methods  for  improving  estimation  and  judgment, 
most  of  which  have  had  field  tests  in  intelligence  analysis,  but  which 
deserve  greater  investigation  in  controlled  laboratory  settings. 

Students  and  Managers  of  Intelligence 

Serious  scholars  of  intelligence  may  find  the  analysis  of  the 
characteristics  of  estimates  in  Chapter  2  of  interest;  in  particular  the 
discussion  of  prediction,  specificity,  and  precision. 

The  biases  described  in  Chapter  4  are  not  unique  to  naval  analysis 
or  intention  estimation  and  may  weaken  intelligence  analysis  of  all  forms. 
Similarly,  the  suggested  methods  for  improvement  (Chapter  S)  have  had  seme 
favorable  reception  in  intelligence  production  and  deserve  further 
investigation  and  application. 
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CHAPTER  2.  CHARACTERISTICS  OP  ESTIMATES 
METHODS  OF  PREDICTION 

The  prediction  of  the  future  behavior  of  another  actor,  such  as 
the  Soviet  Navy  can  rely  on  three  modes  or  methods  of  analysis,  which 
Scheibe  (1979)  has  labeled  sagacity,  control,  and  acumen. 

Sagacity 

Sagacity  depends  on  the  understanding  of  an  analyst  or  estimator  of 
relationships  between  subtle  cues  and  behaviors.  A  simple  example  would 
be  the  analyst  who  uses  the  number  of  submarines  now  in  various  stages  of 
completion  in  Soviet  yards  as  an  indicator  of  future  Soviet  submarine 
strength.  A  more  subtle  example  is  the  relationship  analysts  perceive 
between  a  few  marker  words  and  Soviet  military  doctrine  (McConnell,  SNI; 
605-614;  Oismukes  and  McConnell,  1979s  314;  Gallagher,  SNP,  ch»  3; 
MccGwlre,  SRI,  ch.  2;  it  is  sometimes  argued  that  these  perceived 
relationships  are,  in  fact,  illusory).  By  observing  which  features  are 
correlated  with  a  behavior,  or  precede  a  behavior  regularly,  the  analyst 
becomes  able  to  forecast  the  behavior  by  watching  the  Indicator  cues,  much 
like  a  doctor  can  forecast  the  future  course  of  an  illness  by  making  an 
appropriate  diagnosis  and  using  it  for  prognosis.  The  key  to  this 
prediction  process  is  association,  either  immediate,  or  distant. 
Immediate  association  occurs  when  the  indicator  cues  are  perceived  as 
closely  related  to  the  behavior  to  be  predicted,  for  example,  when  the 
indicators  occur  just  before  the  behavior.  An  important  class  of  these 
associations  are  those  the  analyst  view*  as  causal  —  the  occurrence  of 
indicator  cues  are  perceived  as  necessary  and  sufficient  for  the 
occurrence  of  the  behavior.  For  example,  the  analyst  might  perceive  a 
strategic  threat  to  the  Soviet  homeland  as  the  cause  of  a  Soviet  Navy 
fleet  attack  on  Western  forces,  believing  that  auch  an  attack  would  occur 
only  when  such  a  threat  was  perceived  by  the  Soviets* 

Distant  associations  might  depend  on  data  that  are  diagnostic 
rather  Shan  immediate  or  causal*  The  fact  that  a  particular  Soviet  task 
group  Include#  ships  with  surface-to-surface  missiles  may  suggest  a 
tendency  for  that  task  group  to  behave  in  particular  ways  that  it  would 
mot  if  it  were,  say,  composed  of  surface-to-air  or  antisubmarine  warfare 
ships.  In  another  example,  Pstirsa©  (in  Dismuke*  and  McConnell,  1979s  46, 
91)  has  noted  shat  the  age  of  Soviet  turf ace  ships  is  inversely  related  to 
their  out -of -area  deployment  and  the  frequency  of  their  port  calls  in  the 
Third  World  —  the  Soviet*  tend  to  call  with  their  newest  ahlpt,  Age  is 
thus  somewhat  diagnostic  of  mission,  and  hence,  future  behavior* 

-  Obviously,  whether  an  empirical  relation  between  indicator  and 
behavior  is  immediate  or  distant  depends  on  factors  other  than  causality 
and  disiposticity,  and  is  in  part  subjective:*  furthermore,  an  association 
mar  be  very  strong  but  not  very  predictive,  for  example,  the  probability 
that  a  soviet  ship  making  a  port  call  will  be  modern  is  quite  high,  but 
the  probability  that  any  given  modern  Soviet  warship  will  make  a  port  call 
is  probably  quite  modest,  fort  call  predicts  age  better  than  age  predicts 
port  call* 

in  addition  to  an  observed  empirical  association  between  indicator 
mad  beliavlcr,  the  analyst  may  rely  upon  a  theoretical  relationship  or 
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association  between  indicator  and  behavior.  This  theoretical  association 
may  result  from  some  insight  of  the  analyst  into  the  dynamics  of  the 
behavior,  as  when  the  analyst  notes  that  the  increased  strategic  radius  of 
U.S.  Navy  units .created  by  the  A-3  strike  aircraft  and  the  Polaris  system 
would  "draw  out"  the  Soviet  Navy  into  a  forward  deployment.  Predicting 
such  a  relation  between  indicator  (increased  range  of  strategic  threat) 
and  behavior  (forward  defense)  could  not  be  deduced  from  empirical 
observation,  except  in  hindsight.  It  could  be  inducted,  in  foresight, 
from  a  theoretical  analysis  of  the  causes  of  the  dynamics  in  Soviet  naval 
defensive  strategy. 

Control 


The  second  predictive  method  Scheibe  noted  depends  upon  control  of 
behavior.  By  controlling  situations,  or  rewards  and  punishments,  it  is 
often  possible  to  accurately  predict  behavior.  Analysts  of  the  Soviet 
Navy  rarely  exercise  any  meaningful  control  over  the  subject  of  their 
study.  Such  control  is  not  impossible  however.  The  "intelligence 
experiment"  can  provide  predictive  information  by  controlling  the 
information  available  to  an  adversary.  An  historical  example  of  an 
intelligence  experiment  occurred  in  World  War  II  when  U.S.  naval 
intelligence  had  messages  sent  in  the  clear  about  Midway  Island  being 
short  of  water.  Japanese  intercept  stations  monitored  this  traffic  and 
U.S.  intercept  stations  in  turn  monitored  Japanese  traffic  that  revealed 
that  the  target  of  the  forthcoming  Japanese  attack  was  abort  of  water. 
Through  this  experimental  control  the  U.S.  analysts  confirmed  the  identity 
of  the  Japanese  target. 

While  the  analyst  may  not  control  the  situation  or  the  reward 
structure,  he  or  she  may  be  able  to  predict  the  behavior  of  an  ap^' 1 
does  have  such  control.  It  may  be  possible  to  predict  the  *> 

Admiral  Gorshkov,  and  since  he  exercises  control  over  certain  v  ■  * 

the  Soviet  Navy,  predict  what  those  aspects  will  he  in  cue  *  u;.', 

Similarly,  by  assessing  the  state  of  the  art  of  Soviet  hydroacoustics  the 
analyst  may  he  able  to  predict  future  Soviet  acoustic  ASW  capabilities  and 
tactics.  At  times  the  agent  of  control  is  the  analyst's  own  country,  Thu 
analyst  who  was  awar^  that  the  Polaris  system  would  impose  new  defense 
requirements  on  Soviet  naval  fares#  mould .  predict  the  Soviets  would  react 
to  this  requirement,  While  it  is  not  always  easier  to  predict  she  future 
actions  of  one's  own  country  than  those  of  an  adversary,  the  patterns  of 
aetion*r@a®tion  that  often  character!-**  military  b»w#*  provide  the  analyst 
a  useful  control  prediction  tool,  at  second  hand  as  it  were. 

Acumen  \ 


The  third  method  of  prediction  which  Scheibe  describes  is 

ficuaen.  Of  psychological  penetration: 

»  *  ,  m  appreciation  of  the  other's  point  ©f  view  in  a 
specific  place  end  time  •  »  »'  a  particularised  act  of 
identification  with  the  other  *  »  .  penetration  to  the 
specific  thoughts  and  intentions  of  a  specific  person  (p. 

40)* 


Recently  an  historian  recommended  such  acumen  as  a  major  element  of 
effective  intelligence  analysis.  Richard  Pipes  (in  Godson,  1980)  argues 
(p.  177)  that  historical  scholarship  was  one  of  the  "keys  to  political 
intelligence  analysis"  and  that  the  other  was 

...  a  deep  knowledge  of  the  country,  of  its  general 
culture  and  its  political  culture  in  particular,  from  what 
the  Germans  call  Fingerspritzengefuhl ,  ’•he  feeling  'on  the 
tips  of  your  fingers'  tor  a  given  culture  where  you  know 
that  some  things  are  more  probable  and  others  less  so. 

In  many  respects  acumen  is  the  result  of  pure  reasoning, 
developing  an  appreciation  of  the  other's  options  ana  accurately  assessing 
the  probability  that  a  particular  option  will  be  chosen.  James  (larch 
(1978)  characterized  rational  choice  in  these  terms:  "a  guess  about 
uncertain  future  consequences  and  a  guess  about  uncertain  future 
preferences"  (p.  S87).  Decision  analysis  (which  is  just  applied  rational 
choice)  offers  one  means  by  which  an  analyst  might  clarify  his  or  her 
thinking  about  how  the  adversary  is  making  these  guesses.  "A  player  with 
greater  acumen,"  Scheibe  wrote  (p.  52),  "will  be  able  to  penetrate  a  game 
tree  more  deeply  by  accurately  eliminating  from  consideration  the  range  of 
moves  which  the  opponent  is  not  likely  to  exercise."  Decision  analysis 
could  help  the  analyst  outline  the  game  tree  and  enumerate  uncurtain 
future  consequences  and  uncertain  future  preferences  of  an  adversary. 

Prediction  Requirements 

Given  these  three  methods  of  prediction,  what  are  their 
requirements;  what  must  the  analyst  be  able  to  do  to  effectively  employ 
them? 


Sagacity,.  At  *  minimum  sagacity  requires  the  analyst  to  (!) 
categorize  the  behavior  and  the  indicator*,  and  measure  them,  (2)  detect 
correlations  between  the  two  seta  of  categories,  (3)  distinguish  causal 
from  ntmcsv^si  teUti  soahipa,  (4)  detect  diagnostic  information  in  the 
categories,  (5)  formulate  theoretic  relationships  between  categories ,  (6) 
inductively  and  deductively  reas.cn  from  the  indicator  categories  to  a 
prediction  of  the  behavioral  categories,  (7)  adjust  reasoning  in  the  wake 
of  confirming  or  ditconfirming  experiences  tinhorn,  1974,  for 
comparable  analysis  of  the  psychometric  criteria  for  expertise). 

Control ♦  to  employ  control  for  prediction  the  analyst  must  (t> 
character***  the  relationships  of  the  control  situation  <!*«.,  know  what 
in  eon  trolling  what),  (t)  be  able  to  influence  the  controlling  agent 
(directly  or  through  guile*  at  in  the  intelligence  experiment),  or  (3)  be 
able  to  oae  sagacity  or  acumen  to  predict  the  controlling  agent. 

Acumen*  the  requirements  for  insight  are  by  no  means  clear  (ice, 
e»g%,  otaatein,  1977),  Imagination  and  empathy  are  undoubtedly  useful  in 
creating  a  representation  of  the  other'*  decision  process,  historical 
scholarship,  cultural  experience,  and  decision  analysis  are  probably 
useful  in  validating  that  representation  although  warnings  abound  for  each 
enterprise  (e-g.,  «ee  (Fischer,  1970,  or  Fischhoff,  1980a,  on  history). 
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But  the  problem  of  acumen  Is  an  extremely  difficult  one  to  solve  even  when 
the  decision-maker  is  oneself  (e  g.,  Howard,  1080;  Fisehhoff,  1977,  1980; 
March,  1978)*  For  example,  what  is  “optimal”  Is  highly  subjective 
(Elnhorn  and  Hogarth,  1981),  Influenced  by  the  context  (or  framing)  of  the 
problem  (Tversky  and  Kahneman,  1981),  and  unstable  (March,  1978).  Each  of 
these  difficulties  is  even  greater  when  the  subject  of  acumen  analysis  is 
not  oneself  or  an  accessible  client,  but  a  remote  and  possibly  wary 
adversary,  also  capable  of  acumen* 

Scientists  have  just  begun  to  understand  how  people  develop 
insights  into  such  problems  as  physics  and  chess  (e-g.,  Larkin,  et  al., 
1980).  For  example,  people  who  have  “physical  intuition."  or  insight  into 
the  means  of  solving  physics  problems  (“experts”)  tend  to  have  a  greater 
body  of  knowledge  about  physics  than  do  those  with  few  insights 
(“novices”).  In  addition,  experts  have  that  knowledge  efficiently  indexed 
by  patterns  that,  when  recognized,  guide  the  export  to  the  relevant  parts 
of  his  or  her  store!  knowledge.  Larkin,  et  al.  (1980:  1336)  characterize 
physical  intuition"  as  knowledge  organised  into  complex  schemes  that 
guide  a  problem's  interpretation  and  solution.  Similar  conclusions  have 
been  reached  about  mathematical  and  engineering  problems  (e.gt, 
Mickelgren,  1974). 

It  should  be  noted,  however,  that  physical  and  mathematical 
problems  have  optimal  solutions-  It  is  easy  to  determine  whether  the 
problem-solver  chose  the  correct  answer  or  took  the  right  steps  towards 
the  solution.  There  is  no  uncertainty  associated  with  these  judgments 
either.  Many  decisions  that  are  of  interest  t©  the  naval  analyst  are  not 
so  easily  scored.  One  reason  for  this  is  this  the  Soviets,  like  ©there, 
must  snake  "trade-off"  decision®  — *  benefits  must  be  weighed  against  costs 
and  one  "good”  weighted  against  another,  Rather  than  the  best  decision, 
the  problem-solver  or  decision-maker  seeks  the  best  within  constraints, 
and  such  decisions  are  made  in  an  uncertain  environs©©'  where  future 
values  ami  outcome  can,  as  best,  be  known  only  probabilistically. 

The  story  is  oft  repeated  that  Soviet  Maey  commander  (harshkov  has 
in  his  office  a  large  sign  to  the  effect  that  ‘‘better  is  enemy  ©f  good 
enough"  (Kehoe,  MI,  p*  386).  Evidence  from  Soviet  shipbuilding  is 
entirely  consistent  with  the  notion  that  the  Soviets  are  very  good  ship 
engineers  and  make  rational  tradeoffs  between  ship  qualities  and  casts 
(e-g',  Meier,  SMI,  eh*  SO),  It.  is  less  clear  why  they  perceive  various 
aspects  of  ships  as  qualities  or  give  them  the  weight  they  da  («*§,,. 
Keh ©e,  SMI,  eh,  l$t  ftiorfw,  MPSI,  eh,  §>- 

Despite  these  differences,  decision  insights,  like  ohyaieal  or 
intuit  ten.  probably  rely  ©a  complex  *efc«ms&  of  knowledge 
■whl€h  ftfcft  "expert"  uses  is  recognise  types  of  problems,  •  the  naval 
Intelligence  analyst  attempting  to  use  Mumeo  to  predict  Soviet  behavior 
needs  to  construct,  if  only  implicitly  (but:  preferably,  explicitly),  a 
asHai  ©#  Soviet  devi § ion-making  sehesses. 

mcmcm  er  tmmttm. 

Intentions  involve  four  different  elements:  an  action,  the 
target  at  which  the  action  Is  directed,  the  situation  in  which  the  net  ion 
is  to  take  place,  and  the  tin-,*  at  which  the  ess  ion  Is  to  he  performed. 
Each  of  these  elements  varies  along  u  dimension  of  specificity,  it  the 
most  specific  level  is  the  plan#  a  detailed  set  of  instructions  describing 


IS 


•11  pluses  of  action,  target,  situation,  and  tine.  Even  a  very  specific 
plan  nay  fall  to  foresee  every  contingency  la  the  situation,  or  provide 
all  the  details  needed  to  effectively  accoaplish  the  action.  At  the  most 
global  (least  specific)  level  intentions  may  lack  detail  on  each  of  the 
four  elements  and  aay  reflect  only  the  general  orientation  of  one  actor 
toward  another.  The  following  diagram  follows  the  outline  of  Fiahbein  and 
Ajren  (1975:  296)  and  uses  entries  from  McConnell  (in  Diauukes  and 
McConnell,  1979)  to  demonstrate  the  specificity  of  intention. 

As  Figure  2,1  suggests,  estimates  of  Soviet  naval  peacetime 
intentions  may  he  highly  specific.  On  the  other  hand,  many  estimates 
provide  no  more  Man  a  global  intention  and  a  cluster  of  actions,  and  fail 
to  predict  sr  ic  actions,  situations,  and  times  these  general  actions 
will  occur. 

Specificity  and  Precision 

The  specificity  of  an  intention  estimate  it  cloasly  tied  to  the 
possible  precision  of  that  estimate.  It  is  impossible  for  a  vague,  global 
intention  estimate  to  be  precise.  The  minimum  level  of  specificity  for 
intention  estimates  is  specific  action.  This  at  least  permits  precise 
measures  of  behaviors.  This  level  lacks  precision  on  when,  where,  or  in 
what  circumstances  the  specific  action  will  occur.  An  estimate  limited  to 
intentions  for  specific  actions  may  have  great  utility  nonetheless, 
especially  for  such  tasks  as  engineering  counter tactics. 

Forecasts  anil  Fredic t ions 

Estimates  of  i-t tent Sons  may  be  either  highly  precise  fi.e. 
predictions)  or  loss  precise  (i  e. ,  forecasts).  The  distinction  between 
forecast  and  predictions  is  by  no  means  a  settled  issue  (e.g.,  see 
Freeman  and  Job,  1979:  115  ff),  but  we  will  take  prediction  to  mean  an 
estimate  of  all  four  specifics  of  intuit  top:  the.  action,  the  target  of 
thfe  action*  the  situation  in  which  the  action  is  to  take  plate,  and 'the 
time  at  which  the  action  will  be  performed.  If  any  of  these-  four 
specifics  is  omitted,  we  teru  the  estimate  a  forecast  so  long  as  at  least 
one  specific  element  remains* 

Several  readers  win  take  exception  to  these  deft  nit  tons, 
especially  that  of  forecast.  Others  <«.§. ,  Freeman  and  Job,  1979:  lit) 
define  prediction  much  as  we  do,  but  define  a  forecast  as  a  prediction 
without  specification  of  situation..  This  seems  too  precise  to  us*  Some 
estimates  ts  so  further  than  saying,  "Theft  is  a  small  likelihood  that  the 
Arabs  will  sowat  a  dramatic  Initiative  against  Israel  in  the  next  lew 
months  *  i.t, ,  only  the  time  and  target  fsttnst  are-  specified  fthis  and 
other  examples  are  from  state  ©epartmeat  Intelligence  reposts,  see  SThsMy 
and  Ctmiplin,  497 Si  ITS).  This  vagueness  is  not  unusual  in  actual 
estimates,  and  should  be  labeled  as  something  other  than  predictions, 
which  implies  validation  nr  falsification.  Many  intelligence  forecasts 
for  pro  lections,  of*  O'Leaey  and  Copiiw,  p»  173)  cannot  be  verified  nr 
falsified,  ««§.:- 

yrngressive  deterioration  o#  the  situation  over  tine  could 

lead- to  major  hostilities.  (Specifies  situation, ) 
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Nasser  may  decide  that  some  sort  of  military  action, 
regardless  of  the  consequences,  is  the  least  risky  course 
left  to  him.  (Specifies  action.) 

Egyptian  suspicion/hostility  toward  Israel  is  unlikely  to 
diminish  under  Nasser  or  his  successors.  (Specifies 
target.) 

Despite  being  specific  on  one  factor,  the  lack  of  specificity  on  any  other 
factors  prevents  any  useful  disproof  of  thesrs  estimates  (e.g.,  can  anyone 
actually  determine  if  "Egyptian  suspicion/hostility  toward  Israel"  has  or 
has  not  "dinu  lshed"?). 

Time  Horizon 

The  expressions  short-range,  short  run,  or  short-term  and 
long-range,  long  run,  or  long-term  are  often  used  by  estimators.  Rarely 
do  estimators  specify  what  chronological  periods  are  meant  by  these 
expressions.  This  vagueness  is  not  uncommon: 

Rarely,  if  ever,  do  [forecasters]  specify  where  the  boundary 
between  short-range  and  long-range  lies  or  what  exactly  is 
meant  by  short  and  long.  While  there  is  a  traditional 
requirement  in  science  to  replace  qualities  by  quantities 
this  tradition,  apparently,  is  not  applied  to  the  realm  of 
prediction  and  forecasting  (Taschdjian,  1977:  41). 

Both  historical  explanations  and  future  predictions  have,  time 
horizons.  This  horizon  is  the  boundary  which  separates  what  can  be 
explained  (in  the  past)  or  foreseen  (in  the  future)  from  what  cannot.  An 
historical  explanation  can  be  extended  into  the  past  only  so  far  before 
its  important  variables  become  anachronisms  (e.g.,  nuclear  deterrence 
cannot  be  applied  to  explain  events  prior  to  1945). 

Historians  sometimes  do  attempt  to  explain  history  in  terms  of 
First  Causes,  just  as  some  analysts  of  the  Soviet  Union  reoort  to  an  image 
of  primal  Russian  man  as  an  explanatory  device.  Such  explanations  are 
hardly  worthwhile  since  they  usually  fail  to  link  events  with  proximate 
causes  and  they  offer  feeble  links  between  events  and  distant  causes.  The 
greater  the  distance  in  the  past  the  lower  the  relevance  of  the 
connections,  because  the  number  of  contributory  causes  increases 
tremendously  as  the  explanation  reaches  farther  into  the  past. 

When  estimators  use  the  recent  past  and  the  present  for 
predictions  and  forecasts  they  assume  past  trends  will  stay  valid  through 
the  time  horizon  of  the  forecast.  As  that  horizon  extends  there  is  less 
probability  that  the  ceteris  will  remain  paribus ,  i  e.,  the  present  and 
past  trends,  extended  Into  the  future,  are  more  likely  to  change.  The 
immediate  past  and  the  immediate  future  are  approximately  related  in  a 
straight,  linear  fashion.  The  multitude  of  starting  points  in  the  distant 
past  converge  on  the  present.  The  possible  courses  of  future  events 
diverge  from  the  present.  As  events  become  more  distant  from  the  present, 
either  in  the  past  or  the  future,  they  are  less  likely  to  be  related  in  a 
straight,  linear  manner  to  present  events. 

For  example,  Ascher  (1978)  has  found,  for  a  variety  of  forecast* 
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(energy,  population,  economics,  transportation),  that  the  more  distant  the 
period  forecast,  the  greater  the  error,  although  the  relationship  between 
distance  and  error  is  by  no  moans  linear. 

In  contrast  to  the  forecasters  Ascher  studied,  naval  analysts 
rarely  specify  the  date  for  which  they  are  making  a  prediction.  Instead, 
naval  analysts,  when  they  consider  a  time  horizon  at  all,  usually  do  so 
within  a  situation-contingent  context.  That  is,  they  tend  to  estimate  how 
rapidly  or  slowly  the  Soviet  Navy  might  act  within  the  context  of  a 
specific  situation,  e.g.,  crisis.  This  form  of  contingent  time  prediction 
implies  that  time  predictions  are  only  accurate  if  situations  can.  be 
correctly  identified,  and  their  onset  accurately  marked. 

It  is  interesting  that  naval  analysis  of  Soviet  capabilities  has 
highly  specific  time  horizons,  but  that  analysis  of  Soviet  naval 
intentions  does  not.  That  is,  analysts  of  capabilities  realize  that,  for 
example,  ships  must  be  planned,  designed,  constructed,  and  delivered  on 
schedules,  and  that  the  ‘"physics'  of  these  schedules  allows  the  analysts 
to  project  when  systems  will  pass  various  stages.  However,  even  those 
naval  analysts  who  believe  Soviet  naval  behavior  is  planned  seem  not  to 
find  evidence  of  the  time  factor  in  those  plans.  In  fact,  such  analysts 
tend  to  explicitly  avoid  the  concept  of  a  Soviet  timetable.  This  Implies 
that  the  Soviets  have  only  flexible,  contingent  plane,  although  the 
Soviets  may  have  a  general  framework  for  coercive  naval  diplomacy,  for 
example.  While  an  estimate  of  capabilities  which  lacked  an  explicit  time 
Horizon  would  be  automatically  judged  incomplete,  estimates  of  Soviet  Navy 
plans  for  future  peacetime  behavior  that  included  an  explicit 
consideration  of  time  would  probably  be  judged  highly  as  improbable  by 
other  analysts.  On  the  face  of  it,  however,  there  is  no  less  reason  why 
the  Soviets  should  not  change  their  planned  capabilities  than  they  should 
their  planned  behaviors. 

Situation  Prediction 

The  situation,  or  context,  in  which  action  takes  place  tends  to  be 
the  framework  of  many  naval  estimates.  The  two  most  common  and  general 
situations  considered  are  wartime  and  peacetime  missions.  Wartime 
missions  are  generally  subdivided  into  nuclear,  general  conventional,  and 
limited  war.  Peacetime  naval  tasks  include  such  subdivisions  as  strategic 
deterrence,  diplomatic  presence,  power  pfoleetion,  crisis  Influence, 
client  support,  demonstrations,  exercises.  Specification  of  situations 
dictate  the  conditions  and  circumstances  under  which  the  Soviet  Navy  would 
take  or  avoid  a  particular  action. 

Two  means  of  specifying  peacetime  situation©  seem  to  be  used  by 
naval  analysts  in  our  samples  scenarios  and  ’"rules  of  the  psae*""  The 
authors  of  Securing  the  Seas ,  for  example,  outline  several  scenarios  which 
might  lead  to  a  U.S.-tfSSR  naval  confrontation.  Scenarios  usually  specify 
a  particular  geographic  region  (e»g> ,  the  Middle  Bast),  specific  actors 
(e.g.,  Persian  iiulf  naval  states,  the  U.S.  and  Soviet  Navies),  and 
particular  actions  (e.g.,  attempts  by  Persian  Gulf  states  supported  by  the 
Soviets  to  block  the  flow  of  Western  oil).  In  contrast,  KcCunneli  (in 
Oismukes  and  McConnell,  1979,  ch.  7)  attempts  to  specify  the  various 
diplomatic  security  missions  the  Soviet  Navy  night  undertake  in  a  variety 
of  regions,  for  different  Third  World  actors*  and  which  might  involve 
several  different  actions.  Clearly,  McConnell's  “rules'*  are  far  acre 
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flexible  and  able  to  cover  more  situations,  but  are  much  less  precise, 
than  particular  scenarios.  On  the  other  hand,  a  particular  scenario  is 
not  likely  to  occur,  l.e,  it  is  likely  to  be  wrong  in  one  or  more 
particulars.  McConnell's  “rules,"  by  attempting  to  specify  future 
relationships,  rather  than  specific  future  events,  are  less  empirically 
testable,  but  perhaps  more  theoretically  heuristic  as  a  result.  That  is, 
his  rules  do  not  specify  which  particular  actions,  actors,  or  targets  will 
be  present  in  any  given  situation  (although  the  rules  restrict  the  range 
somewhat  for  each  situation).  Instead,  the  rules  generate  a  limited 
number  of  situation  types  which  are  loose  enough  to  include  most  or  all 
anticipated  Soviet  naval  diplomatic  activity.  The  "rules"  do  not  predict 
intentions  so  much  as  suggest  the  likely  bounds  on  various  situations 
(e.g.,  the  Soviet  Navy  would  not  risk  confrontation  with  the  West  in  a 
particular  situation,  but  may  risk  increasing  tension,  etc). 

Target  and  Action  Specification 

Naval  analysts  are  often  quite  preciae  in  specifying  the  targets 
and  actions  of  the  Soviet  Navy  in  certain  elaborated  scenarios.  For 
example,  the  frequent  contacts  between  Soviet  Navy  anti-carrier  warfare 
(ACW)  ships  and  U.S.  aircraft  carrier  task  groups  during  Middle  Eastern 
crises  (e-g.,  196/,  1970,  1973)  have  led  to  fairly  precise  estimates  of 
how  the  Soviets  will  organize  and  deploy  their  ACW  forces  against  the 
carrier  target3.  In  general,  to  the  degree  that  the  targets  are  naval 
systems  and  capabilities  (e  g.,  aircraft  carriers  and  task  groups),  or 
naval  actions  (e  g.,  amphibious  lottervention  ashore),  naval  analysts  seem 
able  to  estimate  specific  Soviet  naval  actions  and  targets  of  action.  As 
the  targets  become  leua  naval  in  nature  the  estimates  become  leas 
specific  and  differ  more  from  each  other.  For  example,  when  the  general 
target  is  Third  World  client  states,  naval  estimators  are  much  less 
precise  in  specifying  the  naval  actions  and  specific  targets  of  Soviet 
naval  action.  Analysts  tend  to  differ  on  which  actions  the  Soviet  Navy 
will  try,  on  the  targets  the  Soviets  will  try  to  influence,  and  the  goal® 
the  Soviets  aeem  to  be  trying  to  achieve.  When  targets  are  more  ns  ,1  in 
uature  (eg  ,  U.S.  carrier  groups)  analyst  disagreements  on  Soviet  actions 
and  goals  diminish  (but  do  not  altogether  disappear). 

Scoring  Predictions  and .Forecasts 

it  t«  quite  straightforward  to  evaluate  the  accuracy  and  validity 
of  a  prediction;  one  simply  compare*  it  to  reality,  if  the  action, 
target,  situation  and  time  coincide  with  events,  the  prediction  was 
confirmed,  it  is  far  more  difficult  to  score  forecasts.  An  analyst,  for 
example,  forecasts  an  increase  in  military  action  but  fail*  to  specify  the 
time  hurt son.  Mow  dots  one  evaluate  this  openendcd  statement  —  the 
forecast  becomes  true  just  as  soon  as  the  projected  action  takes  place, 
and  stays  open  until  it  becomes  true.  Some  forecasts  can  be  more  easily 
scored  than  others,  e-g.,  those  that  specify  action  and  time.  For 
example,  projections  of  Soviet  naval  capabilities  may  only  specify  what 
the  Soviets  will  build  and  the  dates,  without  reference  to  targets  or 
situation,  these  projections  can  be  scored  straightforwardly,  forecasts 
of  Soviet  naval  intentions,  particularly  those  cast  in  situationaily 
dependent  terms,  ace  more  difficult  to  score  correctly*  particularly  if 


Table  2,1.  Characteristics  of  Complex  and  Honcomplcx  Annlynlo 


Noncoronlnx  Analysis 

1.  Vague  gonlo  for  analysts  and  no 
clear  criteria  Cor  specificity 
of  conclusions. 

2.  Limited  or  nonexistent  plan  of 
analysis,  no  schematic  blueprint 
for  sequencing  the  inference  end 
deduction  process, 

3.  No  clear  relation  between 

(a)  methods  and  data,  and  (b) 
conclusions  or  recommendations. 

4.  Little  connidcration  o?  dynamic 
processes  in  time;  primary  focus 
on  the  status  quo. 

5.  Repeated  use  of  sane  unaiytic 
r.cthod,  or  Home  data  base,  with 
little  increase  in  new  information. 

6.  Minimal  critical  reflection  on 
methods  employed,  no  use  of  devil’s 
advocacy,  multiple  methodology, 
hypotheses  disconfirmatiou. 


?,  heavy  reliance  on  unproven 
hypotheses,  assumptions,  con-* 
vent local  wisdom,  stereotypes, 
doctrinal  "givens, H 

6,  Focus  on  email  details, 

9.  Use  of  Mghlyglibal,  single-factor 
theories  for  large  scale  phenoceoa. 


10,  Testing  to  confirm  hypotheses 
(fortifying  arid  cat  reaching). 

11,  Thematic  vagabonding 5  rapid,  super¬ 
ficial  shifting  Stem  concept  to 
concept*  insufficient  development 

of  events  or  esplaaotioux. 

12,  Explsnatiess  In  teems  of  causal 

■  series,  single  causes  sod  single 
effects. 


13.  Surprising,  large*  nr  sudden 
changes  are  not  foisted  to  the  jp&ts. 

14,  Uft«iilitvgft?sa  to  reach  decisions, 
sahia  predietinns  nr  fetetnsts* 
and  trndsney  to  draw  contradictory 
conciusiuos. 


Complex  Analysts 

1.  Explicit  goals  and  criteria  for 
specifying  content  of  conclusion. 


2.  Clear  methodological  outline,  ex¬ 
plicit  statement  of  relations 
between  methods  and*  Inferences. 

3.  Explicit  criteria  for  weighing 
methods  and  evidence  agninst 
conclusions. 

4*  Attempt  to  account  for  past  trends 
and  tendencies  and  relate  them  to 
the  status  quo. 

5.  Progression  from  conclusions,  to 
new  data,  to  methods,  to  now 
conclusions,  to  new  data... etc, 

6.  Explicit  consideration  of  method 
strengths  and  weaknesses,  attempts 
to  offset  biases  and  weaknesses 
through  multiple  methods,  use  of 
disproof  as  veil  so  confirming' 
evidence. 

?,  Reliance  on  empirical  testing, 

parsimony,  «nd  Occam's  Rarer  rather 
;hsa  convention. 


8,  Emphasis  on  «*ajor  processes. 

9,  Use  of  multiple  hypotheses,  multiple 
d«a  sources *  multiple  no  thud*  to 
building  blocks  of  theory, 

i0.  Testing  to  disprove  hypotheses 
(process  of  eliminatiuo). 

U,  Explicit  links  between  event#  nod 
explanations,  vtfeh  causal  explana¬ 
tions  of  Input-process -output 
relationships. 

12,  Explanations  In  term#  of  suit ip l# 
causes*  eannat  networks  and  Multiple 
effects  (both  mi&  effects  sod  sid* 
uf feces). 

13,  Explanations  in  the  past  at*  xeupht 
for  4c«*atic  OX  ekpouvucinl  changes. 

14,  Effort  to  forecast  «nd  predict , 
ette«>pS:X  made  to  verify  predtctlene* 
internal  ennsiutenty  of  cwwiuaiona. 


the  situational  specifications  are  vague  or  loose.  Furthermore, 
situational  forecasts  are  contingent  predictions  (i.e.,  the  Soviets  will 
do  X  if  conditions  A,  B,  C  obtain,  but  not  otherwise)  which  may  require 
complex  scoring  rules  for  cases  which  approach  but  do  not  actually  reach 
the  exact  specifications* 

COMPLEX  AMD  NONCOMPLEX  ANALYSES 

Doerner's  (1980)  study  of  decision-making  in  complex  environments 
provides  a  list  of  characteristics  for  what  might  be  termed  "complex 
analysis, ”  or  estimates  of  complex  systems.  These  characteristics  can  be 
contrasted  to  noncomplex,  or  simple,  analysis,  which  will  be  inappropriate 
for  the  estimation  of  complex  problems.  The  fact  that  an  analysis  is 
complex  does  not  imply  that  the  conclusions  that  emerge  must  also  be 
complex  —  the  conclusions  may  be  simple.  As  the  list  of  characteristics 
tend?  to  reflect,  it  is  the  analytic  process  and  method  which  is  complex. 

These  two  lists  cannot  be  used  to  assess  estimates'  accuracy  or 
logic.  They  are  only  guidelines  to  evaluate  the  appropriateness  of  an 
estimate  given  the  subject  of  the  estimate.  In  general,  good  estimates  of 
complex  phenomena  will  tend  to  have  many  of  the  characteristics  found 
under  “complex."  Characteristics  listed  under  “noncomplex"  are  those 
Soerner  observed  when  individuals  were  unsuccessful  in  coping  with  complex 
problems. 

If  an  estimate  of  something  complex  does  not  have  many  of  these 
"complex"  characteristics,  it  may  still  be  accurate,  logical,  and 
appropriate.  For  example,  scientists  often  employ  an  analytic  process 
much  like  that  labeled  "complex"  here.  This  may  lead  to  discovery  of  a 
very  strong,  lawful  relationship.  In  reporting  a  scientific  law, 
scientists  traditionally  resort  to  a  style  whose  character  is  somewhat 
like  what  we  have  labeled  "noncomplex,"  Because  the  scientist  has 
succeeded  in  turning  a  highly  complex  subject  into  a  simple  law,  the 
noncomplex  report  la  accurate,  logical,  and  appropriate  (but  perhaps 
alaleading  aa  to  the  real  requirements  for  that  discovery).  If  the 
newly-discovered  law  la  challenged,  the  scientist  may  resort  to  a  full 
“complex"  report  on  its  discovery,  detailing  the  analytic  process. 

Although  these  characteristics  are  only  loosely  diagnostic  of 
whether  an  estimate  is  sufficiently  complex  for  its  subject  matter,  taken 
together  they  offer  an  additional  useful  assessment  teat  for  estimates* 
If  a  large  number  of  the  "noncomplex"  characteristic*  are  noted  in  an 
estimate,  it  may  imply  that  the  estimator,  like  Ooerner's  decision-makers, 
ha*  not  adjusted  his  or  her  thinking  to  the  complexity  of  the  problem. 

THE  LOGIC  OF  ANALYTICAL  PROCESSES 

While  complexity  may  be  diagnostic  of  analytic  appropriateness,  it 
i*  a  poor  index  of  analytic  predictive  success.  Probably  the  beat 
indicator  of  predictive  success  is  the  analyst"*  track  record;  i.c. ,  ha* 
chi*  aoalyit  (or  thi*  analytic  technique)  successfully  predicted  similar 
events  in  the  pestf  Such  a  track  record  can  only  be  meaningful  for 
precise  predictions,  and  tine*  moat  naval  analysts  make  forecast*  rather 
chan  predictions,  such  a  track  record  ecorlng  exercise  is  largely 
impossible  or  useless. 

For  example,  la  our  sample  of  naval  estimates  we  found  some 
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forecasts  and  predictions  about  Soviet  behavior  vis-a-vis  Afghanistan 
which  turned  out  quite  wrong,  e  g., 

.  .  .  the  USSR  has  never  been  in  a  position  of  overwhelming 
military  strength  vis-a-vis  the  rest  of  the  world 5  and  this 
point  alone  induced  caution.  In  other  words,  although  the 
Soviet  Armed  Forces  are  obviously  capable  of  winning  a  swift 
and  convincing  victory  over,  for  example,  Afghanistan,  the 
repercussions  in  the  rest  of  the  world  would  be  such  as  to 
more  than  counteract  the  kinds  of  gain  that,  in  the 
foreseeable  future,  the  USSR  might  win  from  such  an  invasion 
(Vigor,  SND:  19). 

Without  a  means  of  scoring  an  analyst's  overall  successes,  as  well  as 
failures,  the  existence  of  a  stray  miss,  or  a  stray  hit,  serves  no  purpose 
in  assessing  the  analyst's  estimation  methods.  In  short,  the  best  means 
of  assessing  the  methods  of  naval  analysts,  i.e.,  examination  of  their 
prediction  track  records,  is  unavailable  because  the  forecasts  and 
predictions  of  naval  analysis  of  Soviet  intentions  are  far  too  imprecise 
and  unspecific  to  be  scored  meaningfully  or  consistently. 

How  then  can  we  assess  these  analytic  methods?  Although  the 
procedure  adopted  in  this  study  is  inferior  to  assessing  prediction  track 
records,  it  may  be  the  best  possible  given  the  nature  of  current 
estimates.  This  study  dissects  the  intention  estimation  process  into 
distinct  elements;  the  separate  mental  and  logical  actions  typically  taken 
in  the  course  of  un  estimate.  Each  of  these  elements  is  then  evaluated 
from  the  perspective  of  cognitive  psychology,  logic,  and  information 
processing.  That  is,  we  ask  how  well  do  people  generally  perform  such 
mental  and  logical  steps?  Are  there  widespread  weaknesses  or  biases  in 
information  processing  at  that  stage  in  estimation?  Can  we  demonstrate 
that  naval  analysts  actually  experience  these  problems?  In  other  words, 
we  chop  up  the  estimation  effort  into  its  necessary  pieces  and  assess  the 
likely  weaknesses  of  each  piece.  Problems  that  are  invisible  from  the 
perspective  of  the  entire  estimation  process  become  visible  in  these 
individual  pieces. 

Having  found  that  various  pieces  of  the  estimation  process  may  be 
weak,  we  cannot  argue  that  any  particular  estimate  la  weak.  However,  the 
possibility  of  weakness  should  motivat'.  analysts  and  the  consumers  of 
estimates  to  look  very  closely  at  the  methodological  components  of 
estimates,  not  at  just  the  estimate's  contents.  If  such  examination 
reveals  a  bias  actually  present,  this  suggests  at  least  some  greater 
measure  of  uncertainty  regarding  the  estimate's  conclusions.  It  may  imply 
the  conclusion  is  invalid,  thus,  while  we  cannot  in  this  general  study 
pass  judgments  on  individual  estimates,  we  do  outline  a  procedure  for 
assessing  intention  estimation  methods,  and  thereby  assess  the  logic  of 
their  conclusions.  Illogical  methods  can  produce  valid  predictions,  but 
only  by  chance.  Valid  methods  stand  a  better  chance  in  the  long  run  of 
successfully  predicting  future  actions, 

Tito  a?  in  result  of  this  study  Is  to  demonstrate  that  analysts  and 
consumers  of  estimates  can  evaluate  analytic  methods  objectively,  i-e. , 
independently  el  the  contents  of  the  estimates,  by  focusing  on  the 
individual  logical  steps  in  the  estimation  process,  there  Is,  however,  a 
mudi  quicker  means  of  assessing  analytical  predictive  accuracy  for  a  group 


of  estimates.  That  is,  if  several  analysts  make  forecasts  or  predictions 
about  an  event  that  differ  significantly  from  each  other,  they  cannot  all 
be  correct,  and  it  may  turn  out  that  they  are  all  wrong.  But  the  fact 
that  the  predictions  or  forecasts  differ  significantly  implies  some  (maybe 
all)  of  the  analysts  are  going  to  be  wrong,  and  that  the  group  of 
estimates  probably  contains  considerable  error. 

In  the  next  chapter,  several  case  studies  offer  "mini-reviews"  of 
the  estimates  by  our  sampled  naval  analysts  on  significant  questions 
regarding  the  future  peacetime  intentions  of  the  Soviet  Navy.  Wide 
differences  of  opinion  exist  on  these  issues,  implying  some  of  these 
estimates  will  tum  out  incorrect  in  some  particular.  These  cases  serve 
to  demonstrate  this  range  of  difference  (and  thus  the  inherent  range  of 
error),  as  well  as  introducing  the  nonnavsl  analyst  to  some  major 
controversies  in  this  field. 

In  Chapter  4,  the  estimation  process  Is  dissected  and  evaluated. 
Examples  of  information  processing  biases  and  methodological  weaknesses 
are  taken  from  the  sampled  naval  estimates  to  demonstrate  some  problems  in 
methodology  and  logic.  Estimation  is  viewed  from  two  perspectives,  as  a 
process  of  judgment:  and  decision,  and  as  a  process  of  historical 
reconstruction  and  narration.  In  both  cases  the  procedure  is  the  same,  to 
separate  the  process  into  steps  and  evaluate  the  strengths  and  weaknesses 
of  these  separate  pieces.  The  main  characteristic  of  estimates  with  which 
we  concern  ourselves  is  the  logic  of  the  methods.  First,  however,  we  must 
lock  at  the  content  of  some  estimates* 
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CHAPTER  3.  CONFLICTS  IN  ESTIMATES 


I  cannot  forecast  to  you  the  action  of  Russia.  It  is  a 
riddle  wrapped  in  a  mystery  inside  an  enigma;  but  perhaps 
there  is  a  key.  That  key  is  Russian  national  interest. 

Winston  Churchill,  l  October  1939 

There's  a  lot  of  wish  fulfillment  involved  in  our  view  of 
Soviet  political  intentions. 

Richard  helms,  1978 

One  means  of  appraising  estimates  is  to  assess  the  dispersion  of 
(or  differences  between)  estimates  regarding  a  particular  event.  For 
example,  suppose  different  predictions  of  the  number  of  Soviet  submarines 
of  a  certain  type  in  the  year  1990  varied  from  eighty  to  one  Hundred.  The 
minimum  error  in  this  set  of  predictions  is  10  which  occurs  if  the  1990 
figure  is  exactly  90.  That  is,  we  know  now  that  our  set  of  estimates  in 
1990  will  have  an  error  factor  of  more  then  ten  percent,  with  the 
possibility  that  the  error  may  be  much  greater.  If  the  1990  figure  was 
70,  or  110,  for  example,  the  present  estimates  are  in  error  by  30  units. 
If  the  dispersion  of  current  estimates  were  made  greater,  say  75  to  105, 
the  minimum  error  increases  from  10  to  15  units.  The  dispersion  of  a 
present  set  of  estimates  thus  provides  an  index  of  the  minimum  error  (or 
maximum  accuracy)  possible  in  the  future,  but  gives  no  indication  of  the 
maximum  error  that  is  possible.  The  wider  the  dispersion  of  current 
estimates,  the  greater  the  future  error. 

Estimates  of  Soviet  naval  events  rely  on  explanations  of  past 
events,  interpretations  of  currant  operations,  and  expectations  regarding 
future  operations.  In  this  chapter  we  examine  some  differences  between 
estimates  of  various  Soviet  naval  events  in  each  of  these  periods.  The 
differences  between  (or  dispersion  of)  these  estimates  provides  a  rough 
measure  of  the  minimum  error  in  these  examples.  Since  each  ease  of 
differing  estimates  was  arbitrarily  sampled  from  a  much  larger  set,  and  no 
effort  was  made  to  select  those  estimates  whleh  differ  most,  the  range  of 
dispersion,  and  hence  the  minimus  error,  would  increase  as  more  extreme 
estimates  were  added  to  the  current  set. 

As  this  selection  of  different  estimates  will  indicate,  in  each  of 
the  three  periods,  and  for  eaeh  issue,  the  dispersion  of  the  sampled 
estimates  it  considerable,  but  ©wing  to  the  universal  lack  of  specificity 
in  ail  the  estimates  examined,  it  is  possible  to  tench  only  a  qualitative 
estimate  of  the  minimum  error  in  each  ease.  In  most  cases,  however,  even 
these  qualitative  assessments  reflect  what  seem  to  be  serious  minimus 
errors*  it  is  beyond  the  competence  of  this  study  to  judge  how  serious* 
Finally,  the  sampled  cases  or*  by  no  means  the  only  issues  for 
which  there  seem  to  be  large  differences  between  estimator*,  ttere  issue* 
regarding  wartime  Soviet  naval  intention*  Included  in  this  study,  the 
number  of  coses  of  serious  differences  between  estimates  might  easily 
double.  Even  in  the  realm  of  these  estimates  of  peacetime  ini  eat  ions, 
there  are  few  issues  fur  which  the  range  of  estimate*  is  not 
considerable. 


To  summarise,  just  as  differences  between  estimates  betoken 
differences  in  data  bases,  and  methodologies,  they  also  reflect  minimum 
expected  error  of  estimation*  The  consumer  of  estimates  can  reduce 
ml.iinum  expected  error  only  by  narrowing  the  range  of  estimates;  i.e.,  by 
disregarding  extreme  estimates.  The  criteria  for  selecting  estimates  to 
disregard  should  Include  the  potential  weaknesses  in  the  estimation 
methods.  This  analysis  of  estimation  errors  and  fallacies  allows  the 
consumer  of  estimates  to  judge  which  estimates  rely  on  vulnerable  methods, 
and  thus  to  disregard  those  extreme  estimates  which  are  most  probably 
weakest.  The  estimate  consumer  can  thus  reduce  the  dispersion  of 
estimates  in  a  sensible  manner  and  thereby  reduce  minimum  error. 

DIFFERENCES  BETWEEN  ESTIMATES  —  PAST  SOVIET  NAVAL  EVENTS 

Case  It  Soviet  Attitudes  Toward  Surface  Ships,  1953-1961 

• 

Estimators  differ  regarding  Soviet  attitudes  towards  the  surface 
fleet  in  the  decade  following  Stalin's  death.  On  the  one  hand,  the 
statements  of  party  leaders,  the  building  program,  and  the  abolition  of 
the  naval  ministry  and  change  of  naval  commander  are  used  as  evidence  of  a 
shift  from  Stalin's  vision  of  a  well-balanced,  ocean-going  fleet  of  large 
surface  vessels  (including  aircraft  carriers)  to  a  fleet  based  heavily  on 
submarines,  small  ships  and  land-based  aircraft  (e.g. ,  MccGvire,  SND: 
189-92,  203),  On  the  other  hand,  the  statements  of  Admiral  Gorshkov,  the 
deployment  of  naval  units  in  forward  areas  (e.g.,  the  Mediterranean),  and 
Gorshkov's  “salvaging"  of  the  Soviet  cruiser  program  are  used  as  evidence 
that  Soviet  plans  for  a  balanced  fleet  of  surface  vessels  for  forward 
deployment  can  be  traced  back  to  1954  (e.g, ,  Metros,  »»PSP:  39;  Merrick, 
1968s  71*2;  Jameson,  STS:  41;  Biamokes  and  McConnell,  1979:  14). 

Tbit  difference  It  neither  superficial  nor  merely  historical.  The 
former  view  suggests  that  the  structure  of  the  Soviet  fleet  was  determined 
in  large  part  by  economic  stringencies  and  the  mission  requirement  to  keep 
Mtatern  aircraft  carrier*  and  amphibious  task  forces  from  Soviet  coasts. 
In  other  word*,  the  major  causer  of  Soviet  decisions  were  internal 
economic*  and  defensive  needs  in  reaction  to  Western  threats*  The  latter 
view  imp!  1st  execution  of  •  long-term,  well-coordinated  plan  for  forward 
deployment  laid  mere  than  a  decade  prior  to  realisation,  and  followed 
consistently  after  Stalin's  death.  Obviously,  whether  treated  ts  trends, 
or  at  theoretics  1  models  of  relationships,  cheat  two  viewpoint#  offer 
widely  different  explanations  of  the  course  and  determinant*  of  Soviet 
surface  fleet  developments, 

Alter  Stalin's  death  in  March  1953,  the  naval  ministry  was 
abolished,  and  Stalin'*  vision  of  a  big,  balanced  fleet  was  abridged  to  a 
plan  to  build  submarine*,  land  based  aircraft,  and  light,  fast  surface 
forces  (Merrick,  1168:  $2-66).  Admiral  luanetisv,  who  shared  Stalin's 
outlook,  was  replaced  in  1953  by  Admiral  Gorshkov,  who  was  noted  for  his 
interest  in  naval  missile  technology  and  his  World  War  il  leadership  of 
•lock  g«a  naval  operation*  in  support  of  the  ted  Army*  Merrick  (p.  H) 
credit*  Gorshkov  with  saving  the  surface  fleet,  including  the  heavy 
cruiser*,  from  Khrushchev's  and  the  20th  Party  Congress**  move*  to  cut 
these  construction  plans  drastically.  Merrick  (p.  71)  writes; 


To  prevail  on  Khrushchev  not  to  carry  out  his 
publicly-announced  intentions  of  scrapping  90  percent  of  the 
Soviet  Navy's  cruisers,  Admiral  Gorshkov  conducted  a 
well-conceived  and  adroit  but  cautious,  step-by-step 
campaign  over  a  period  of  more  than  two  years.  Gorshkov  s 
goal,  politically  speaking,  was  an  ambitious  and  audacious 
one  —  not  just  to  complete  and  retain  a  large  percentage  of 
the  cruisers  but  to  gain  practical,  if  rot  theoretical, 
acceptance  of  the  continuing  importance  of  large  warships  in 
the  nuclear  era. 

McConnell  (in  Dismukes  and  McConnell,  1979:  p.  2)  argues  that 
“naval  diplomacy  had  no  secure  home  in  Stalinist  Russia"  (a  judgment 
Herrick,  1968,  ch.  4  and  6,  seems  not  to  share)  and  that  naval  diplomacy 
bears  the  marks  of  long-term  Soviet  commitment  commencing  with  Khrushchev 
aud  Gorshkov.  He  writes  (p.  10) 

...  by  the  mid-1950s,  Moscow  appreciated  the  need  for 
coercive  naval  diplomacy  in  the  Third  World,  that  it 
perceived  its  current  capabilities  to  be  inadequate  for  this 
role,  and  had  already  adopted  a  long  term  construction 
program  that  would  create  credible  capabilities. 

Xn  support  of  this  judgment  McConnell  cites  Gorshkov's  1967 
retrospective  commentary  that  the  decision  for  a  diplomacy  of  naval  force 
was  made  in  1954  and  aimed  at  creating  a  balanced,  ocean-going  fleet 
capable  of  nuclear  and  non-nuclear  wars,  and  protecting  state  interests 
abroad  in  peacetime*  McConnell  then  observes 

Gorshkov's  claims  of  consciously  planned  development,  of 
course,  may  have  been  a  rationalisation  after  the  fact  to 
show  the  party's  prescience  and  control  over  events. 

McConnell  nevertheless  rejects  this  possibility,  instead  arguing  that  by 
X 95$  all  the  ingredients,  except  coercive  naval  diplomacy,  of  present 
Soviet  Third  World  policy  were  in  action.  (This  judgment  seems 
inconsistent  with  several  lines  of  evidence,  such  as  the  Soviet  naval 
construction  program  in  the  19$0t  and  the  Soviet's  relinquishing  in  193$ 
of  its  only  two  naval  bases  abroad 4 

Immediately  after  mustering  evidence  in  support  of  Gorshkov's 
claim  that  1954  ©irked  the  decision  low  *  patient  and  restrained  move 
toward  a  navy  of  open^nesan  surface  vessels,  McConnell  turns  Cp*  15)  to 
the  If 14  decision,  revealed  by  “Khrushchev  himself,**  to  'shift  from 
surface  ships  as  the  main  sr»  of  the  fleet  to  a  navy  based  primarily  an 
submarines  and  iecondarily  on  land-based  aviation  and  light  surface 
ship*.'  t&g&ftftell  espiaini  ip*  15)  the  discrepancy  between  Gorshkov's 
claims  and  Khrushchev’s  decision  as  due  to  the  Soviet's  having  ’'aimed 
development ally  at  a  Third  World  diplomacy  of  force  (over  the  decade 
l9$5»4$),  I  but  I  they  were  probably  m%  yet  operationally  seesattttaU'  As 
late  as  He  wr*  «**  tp*  19),  'there  was  still  no  decision  in  favor 
of  a  diplomacy  of  naval  force'  and  eniy  in  with  the  batty  adoption 
of  a  local  war  doctrine,  and  the  I9$f  involvement  of  the  Soviet  Navy  in 
the  bis  -bay  liar  crisis,  does  McCooueli  finally  see  positive  evidence  of  'a 


Id 


real  change  of  policy*  built  on  the  1954  decision  to  "create  credible 
capabilities,"  such  as  surface  vessels,  for  coercive  naval  diplomacy. 

Khrushchev's  frequent,  strong  deprecations  of  surface  ships,  In 
addition  ;.o  the  1954  plan  to  cut  their  construction,  are  obviously 
embarrassments  for  McConnell's  (and  Gorshkov's)  thesis  that  the  1954  plan 
envisaged  balanced,  ocean-going  surface  vessels <.  McConnell  asserts  (p 
13)  that  "in  general,  too  much  has  been  made  of  Khrushchev's  deprecation 
of  surface  ships."  To  minimize  this  problem,  McConnell  argues  first  that 
the  surface  ships  Khrushchev  criticized  were  “gun  cruisers  and 
descroyers,"  not  the  surface  ships  now  used  in  Soviet  anticarrier  task 
groups,  which  rely  on  surface-to-surface  and  surface-to-air  missiles,  and 
which,  by  implication,  Khrushchev  would  not  find  so  objectionable. 
Second,  he  argues  that  the  modern  surface  vessels  were  "the  result  of  a 
production  decision  made  under  either  Khrushchev  or  his  predecessors." 
Herzog  (NPSP:  39)  echoes  this  assessment. 

It  is  hard  to  reconcile  McConnell's  judgment  that  Khrushchev  had  a 
well-hidden  tolerance  for  large  surface  ships  with  either  his  statements 
or  Soviet  naval  construction  under  him.  McConnell's  first  argument 
implies  that  the  anticarrier  task  forces  used  by  the  Soviets  in  crises 
during  their  coercive  naval  diplomacy  period  (circa  1967  to  the  present 
according  to  Disraukes  and  McConnell,  1979)  "typically”  do  not  include  the 
gun  cruisers  and  destroyers  Khrushchev  saw  as  outmoded.  This  is  not  the 
case,  however;  gun  cruisers  and  destroyers  are  often  components  of  Soviet 
anti-carrier  warfare  (ACM)  task  groups  (Dismukea  and  McConnell,  1979: 
173-5,  179,  211-12),  The  fact  that  ships,  which  even  McConnell  seems  to 
grant  were  labeled  by  Khrushchev  as  obsolete,  are  still  to  be  found  in 
service  alongside  more  modern  vessels,  hardly  seems  compelling  evi  ience 
that  Khrushchev's  frequent  caustic  remarks  on  surface  ships  were 
exclusively  deceptive  propaganda,  if  the  core  of  Moscow's  Third  World 
diplomacy  of  force  lies  in  the  Soviet's  noticatrier  task  groups,  as 
McConnell  asserts  (p,  21),  the  continued  presence  of  gun  vessels  can  only 
be  an  embarrassment,  given  Khrushchev's  statements;  an  embarrassment  the 
Soviets  seem  to  have  minimized  by  retiring  Khrushchev  more  quickly  than 
they  have  retired  the  gun  cruisers  and  destroyers  he  deprecated, 

MccGwire's  (SKPi  203)  assessment  of  Soviet  construction  suggests 
that  very  large  cutbacks  in  surface  ship  building  ware  made  as  a 
consequence  of  decisions  in  1954-55  and  1958-59,  which  he  Interprets  as 
major  steps  *v»y  from  *he  goal  of  a  well-balanced  fleet  with  world-wide 
capabilities  —  the  goal  Gorshkov  in  196?  (and  McConnell  later)  assert  was 
the  basis  of  the  1954  decision*  KccGwire  argues  that  not  until  1961  were 
construction  shifts  made  that  reflect  a  move  toward  forward  deployment 
CSHBi  and  a  concerted  build-up  of  surface  fleet  units*  This 

•hid  Its  links  to  the  deployment  by  the  United.  State*  of  the  H  attack 
aircraft  on  aircraft  carriers  and  the  Polaris  submarine  and  missile 
combination,  theme  two  systems  gave  the  tt*st  Havy  the  capability  of 
attacking  the  USSR  from,  over  1200  miles  at  tea,  and  this  "drew*'  the  Soviet 
Kavy  out  to  a  forward  defense* 

MtcCvS.fe  interpret#  theta  surface  ship  building  patterns  as 
indicating  little  Soviet  interest  in  surface  vessel*  until  the  defensive 
mission  requited  new  surface  capabilities  to  deal  with  the  Western  threat* 
ticcGwire  has  noted  (Stfb:  139-41)  that  one  of  the  major  consequences  on 
ship  building  of  the  1954  decision  was  to  shift  shipbuilding  capacity  from 
naval  mar  face  capability  to  the  construction  of  merchant,  fishing,  and 


other  civilian-oriented  shipping.  He  characterizes  (SND;  190-1)  the  1954 
decision  as  follows! 

What  is  perhaps  less  well  known,  and  Is  certainly  not  made 
clear  by  Gorshkov's  (1967)  article,  is  that  the  1954 
decisions  .  .  .  involved  wholesale  cancellations  of  building 
programs  and  a  now  concept  of  operations  that  tied  the  fleet 
even  more  closely  to  the  range  of  shore-based  air  support  . 

.  .  To  the  extent  that  the  Soviet  Union  can  claim  to  have  a 
"balanced  fleet,”  this  stems  from  •  »  «  about  1961  ... 

These  1954  decisions  .  .  .  had  the  effect  of  taking  the 
Soviet  Navy  several  steps  further  away  frota  being  a 
well-balanced  fleet  with  a  world-wide  capability. 

Even  the  1961  decisions,  which  MccGwire  sees  as  directly  related 
to  the  U.S.  Navy  carrier  and  Polaris  threats,  he  labels  (SND!  191)  as 
“exploratory  and  making  do  with  what  was  av. -.liable,  rather  than  the 
culmination  of  some  long-planned  and  well-prepared  policy.”  The  evidence 
of  Soviet  shipbuilding,  MccGwire  writes  (SND :  194),  "argues  against  the 
contention  that  between  1956  and  1962  Gorshkov  fought  a  skillful  and 
partially  successful  rearguard  action  to  save  the  surface  ship  for  the 
Soviet  Navy.” 

Case  2.  Attitudes  Toward  Forward  Naval  Deployments  in  the  1950s 

As  was  discussed  in  Case  i,  McConnell  (in  Dismukes  and  McConnell, 
1979)  accepts  Gorshkov's  claim  that  the  policy  of  protection  of  state 
interests  was  formulated  in  1954.  McConnell  argues  that  this  decision 
formed  the  basis  for  the  gradual  development  of  a  capability  for  coercive 
naval  diplomacy  by  1967. 

McConnell  links  (p.  28)  the  forward  deployment  of  Soviet  naval 
forces  in  the  1960s  to  an  overall  pattern  of  "diplomacy  of  force"  which 
includes  trade,  economic  and  military  aid,  cooperative  naval  diplomacy  as 
well  as  coercive  naval  diplomacy.  Ue  argues  (p,  3)  that  diplomacy  of 
force  plays  a  greater  role  in  Soviet  chan  in  Western  calculations. 
McConnell  describes  (p.  28)  the  intentions  behind  this  diplomacy  as 

.  .  .  Che  credible  intention  is  not  to  prevent  U.S. 
intervention  (in  the  Third  World)  entirely  »*■  Moscow  would 
not  have  the  strength  of  will  for  that  —  but  to  confine 
U.S.  intervention  to  defensive  ends.  The  aim  is  not  to 
deter*  but  to  limit  —  a  limiting  shew  of  force. 

Hersog  (HgSgs  39)  also  suggests  that  exerting  influence  in  areas 
of  unrest  shtouitTnava!  power  was  a  Soviet  goal  of  the  which 
was  hindered  by  inadequate  surface  ships.  The  decision  to  deploy  forward 
based,  open-ocean  naval  forces  he  attributed  to  a  Soviet  desire  to 
influence  events  in  the  third  World  through  seapower.  ttetsag  Cp»  39) 
dates  the  formation  of  this  objective  as  no  later  than  the  1956  Sues 
crisis  Sad  characterises  it  4S  follows: 

The  Soviet  Union  undottbteUAy  saw  in  this  unrest  the 
opportunity  to  extend  its  influence  southward  and  perhaps 


eventually  realise  a  dream  that  haa  been  held  by  Russians 
since  Peter  I  and  Catherine  IX,  the  extension  of  Russian 
control  over  the  Hear  East  and  the  acquisition  of  warm-water 
ports. 

This  la  not  to  say  that  the  strategic  function  of  these  forward 
deployments  is  neglected.  McConnell,  for  example,  writes  (p.  28): 

To  be  sure,  the  focal  point  of  the  Soviet  naval  presence  is 
within  the  arc  of  strategic  concern  often  drawn  at  Polaris 
or  carrier-air  range  around  the  USSR,  but  it  is  also  on  the 
water's  edge  of  a  charmed  political  arc;  in  crisis  after 
crisis  in  the  Middle  East  and  on  the  Indian  subcontinent, 

Moscow  has  reiterated  that  it  cannot  be  “indifferent"  ... 

KccGwire  (SNP:  506,  SND:  191)  traces  the  Soviet  policy  of  forward 
naval  deployments  to  the  evolving  Western  strategic  threats  of  the  late 
1950s  and  early  1960s  — in  the  naval  case  carrier  air  threat  and  Polaris. 
On  the  one  hand,  to  counter  these  threats  the  Soviet  fleet  would  have  to 
venture  out  of  home  waters  in  strategic  defense.  On  the  other  hand,  the 
success  of  Polaris  highlighted  the  potential  of  a  Soviet  SSBN  force,  and 
the  Yankee  program  was  set  in  train.  The  short-term  requirements,  to 
which  MccGw ire  sees  (£ND:  508-510)  the  1958-59  and  1960-61  decisions 
responding,  were  the  need  for  counterforce  strikes  against  carriers  and 
U.S.  SSBNs  before  these  units  could  complete  launching  their  strategic 
strikes.  One  estimator,  who  is  otherwise  an  advocate  of  a  coercive  naval 
diplomacy  interpretation  of  Soviet  forward  deployment,  writes  (Weinland, 
SHP;  380) 

The  Soviets  appear  to  have  adopted  a  “forward  deployment** 
posture  for  .  .  .  strategic  defensive  purposes  —  to  be  in 
position  to  “counter”  U.S.  and  NATO  sea-based  strategic 
offensive  capabilities  .  .  .  This  probably  remains  the 
principle  raison  d'etre  of  the  deployments.  Since  the  late 
1960s,  however,  deployed  force®  have  been  utilised  in  an 
additional  capacity;  as  active  instruments  of  Soviet  foreign 
policy,  protecting  and  promoting  Soviet  oversea®  interests. 

Case  3*.  Soviet  Haval  Objectives  in  Egypt 

Assessments  of  Soviet  tactics  in  the  Middle  East  range  from 
“increasingly  bold”  to  “eeutiouir  to  “prudent,**  Evaluations  of  its 
behavior  vary  from  “running  higher  risks  *  to  “low  risk  “  to 
“circumspect.**  Estimates  of  Soviet  goals  range  from  “alarming  strategic 
outreach*  to  “a  relatively  narrow  agenda,**  Since  these  extremes  related 
to  past  Soviet  behavior  ffer  which  historical  data  art  available)  and  to 
present  and  future  event*  (let  which  more  hypothetical  bases  are  required 
for  estimating),  it  is  not  unreasonable  to  suggest  that  the  range  of 
minimum  error  may  be  large  iu  estimates  of  Soviet  naval  behavior  in  the 
Kiddle  gate* 

The  differences  among  analysts'  explanations  of  Soviet  objective* 
in  Egypt  offer  am  example  of  the  range  in  estimates  for  a  came  in  the 

past. 
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Rubinstein  (SMP:  156)  suggests  that  the  returns  the  Soviets 
received  for  two  decades  of  economic  and  military  aid  invested  In  Egypt 
between  1955  and  1975  were  largely  strategic:  naval  fact  titles  and  air 
bases  useful  in  countering  the  U.S.  Sixth  Fleet.  Some  years  later* 
Rubinstein  (1980)  concluded  that  Moscow  bad  broadened  its  military  probes 
beyond  its  essential  security  tsclc  (which  might  include  the  eastern 
Mediterranean)  and  now  demonstrates  "alarming  strategic  outreach"  (p. 
323).  Rubinstein  in  1975  assessed  Egypt  as  having  considerably  more 
influence  over  the  USSR  than  vice  versa,  and  judged  Soviet  efforts  as 
aimed  at  obtaining  needed  strategic  support  facilities  in  the  eastern 
Mediterranean.  In  1980  Rubinstein  lists  five  Soviet  objectives  in  the 
Middle  East:  1)  undermining  U.S.  alliances,  2)  weakening  Western 
influence  and  position,  3)  expand  USSR  influence  and  position,  4)  obtain 
military  privileges  in  order  to  support  projection  of  Soviet  {Kiwer  on 
behalf  of  friendly  states  and  in  pursuit  of  strategic  advantages,  and  5) 
thwart  a  regional  Pax  Americana,  In  his  1980  article  Rubinstein  notes  the 
“stunning  strategic  setback"  Moscow  experienced  in  Egypt  but  against  this 
he  observes  (p.  334)  the  changes  since,  October  1973  in  Soviet  behavior: 
"an  increasingly  bold  and  confident  forward  policy  •  «  *  (and!  ability  and 
readiness  to  project  power  into  areas  of  opportunity."  lie  perceives 
Moscow  as  pursuing  a  "more  venturesome  policy"  and  "rousing  higher  risks 
for  regional  gain."  He  concludes  that  Moscow's  “military  prowess  has 
encouraged  diplomatic  assertiveness;"  an  assertiveness  Rubinstein  sees  (p. 
335)  as  increasingly  unchecked  by  the  Heats 

In  no  crisis  in  the  Middle  Seat  since  1987  has  the  Soviet 
Union  deferred  to  American  preferences.  Sneroasiogly 
Moscow  determines  the  eoarse  and  outcome  of  regional 
crises. 

WM  difficult  to  see  the  Soviet  reaction  to  the  U»§.  strategic  alert  in 
October  1973  as  anything  but  deference  to  American  preferences.  St  it 
also  difficult  to  d<? seen  Moscow's  hand  in  the  Sran*ira%  and 
Syrian^dordanian*  let  alone  the  continuing  trite*,  or  to 

detect  the  Soviets  detemlnSni  the  courses  and  outcomes  of  Middle  §a*tst% 

events,  but  perhaps  if  has  kept  it*  Hand  well  biddatt.J 

these  two  analyses  by  Rubinstein*  separated  by  five  j-rwre*  clearly 
reflect  an  s«*a§a  of  tmim  itplamz?  and  military  pellcy  In  ktumtlt  flax, 
iarlitr  iovlet  actions  were  far  ms#  eautious  and  directly  tied  t* 
ifmntls  military  rap^resesti*  this  gave  the  twists  little  flexibility 
or  leverage  with  clients  sush;  as'Sgygf--.  Haw,  Rubinstein  argues*  the 
Soviet  military  are  largely  satisfied,  and  the  insists  can 

a4»s  {hair  uany  teals  at  influence  i aid,  trade*  naval  di^iaMcy,  etc.)  for 
,tilr  eain  gtspelit issl  purpose*  i«n»,  eliminating  any  role  In 

kiddie  Eastern  tt&urlsf  affair**  tni  enhancing  the  ie*m  rein. 

In  marked  contrast  I#  Rubin§teln#s  nstinafe  ef  changing  Soviet 
efe|agtivet  in  ®§fpt  and  the  Stent  test*  Hi«sbef§  fs<|p  offers  a  view  swch 
nere  pessimistic:  t&t  tbs  Simsbnrg  su§|i*std  *fcat  the  Snwists  seek 

ifki in  nrdef  t%  sanvect  it  ins#  “sntefial  gains*"*  ^ilitnfy 
instaiietiisnf  *  service  faelUlin,  at  bases.  Hecnuse  §f  a  variety  sf 
limits  @n  their  befcsvist  arid  suscess,  #$nsbur§  letitvss  the  “Vill, 

new,  and  in  the  foceseesbte  future.  pursue  a  relatively  narrow  agenda  *a4 
direct  their  attention  to  a  few  choice  iecatinus  instead  of  spreading 


themselves  thinly”  (p.  446).  He  argues  that  the  Soviets  will  "gravitate 
toward  low  risk  projects"  and  adhere  to  a  cautious  search  for  military 
installations.  Ginsburg  sees  (p.  458)  Third  World  stateu  turning  to  the 
Soviets  if  they  are  rebuffed  by  others  and  if  the  Soviets  can  provide 
needed  services,  but  any  Soviet  "success"  today  may  be  easily  undone 
tomorrow.  In  other  words,  the  Soviet-Egyptian  and  Soviet-Somalian 
episodes  may  easily  reoccur. 

Both  the  Ginsburg  chapter  and  Rubinstein's  1975  (BNP)  chapter 
analyzed  the  interaction  between  the  Soviet  Union  and  client  states.  Both 
examined  the  various  limitations  that  clients  are  able  to  place  on  Soviet 
action,  and  the  degree  to  which  such  limits  circumscribe  Soviet 
flexibility  and  influence.  The  analyses  highlighted  Soviet  dependence 
upon  clients  for  strategic  bases  —  bases  in  Egypt  (to  replace  those  lost 
in  1961  in  Albania)  to  meet  the  strategic  threat  in  the  Mediterranean,  and 
in  the  Indian  Ocean  to  forestall  a  strategic  threat  from  that  area  . 
Rubinstein's  later  (1980)  paper  implies  that  the  Soviets  are  far  less 
dependent  on  foreign  basing.  He  seems  to  imply  that  improved  Soviet 
military  capabilties,  by  reducing  Soviet  reliance  on  foreign  bases,  have 
reduced  the  degree  to  which  client  states  can  hold  Soviet  strategic 
capability  (represented  in  foreign  bases)  ransom. 

Dragnich  (SNP,  ch.  13)  focuses  on  the  Soviet's  efforts  to  secure 
naval  facilities  in  Egypt,  until  recently  the  centerpiece  of  Soviet 
influence  in  the  Middle  East.  He  notes  the  relation  between,  on  the  one 
hand,  Soviet  naval  visits,  diplomacy,  and  strategic  needs,  and,  on  the 
other  hand,  Egyptian  interests.  Up  until  1967  the  Soviet  strategic  need 
was  growing  for  air  and  naval  bases  in  the  eastern  Mediterranean  but 
Soviet  efforts  to  acquire  them  were  completely  unsuccessful.  Only  Egypt's 
disastrous  loss  in  the  1967  war,  and  the  destruction  of  Egypt's  armed 
forces  opened  the  way  for  a  quid  pro  quo  with  the  Soviet  Union:  Soviet 
arms  for  Egyptian  bases. 

Dragnich  rejects  the  hypothesis  that  political  and  diplomatic 
influence-seeking  motivated  Soviet  aid  before  and  after  the  1967  war. 
Rather,  defensive  strategic  deployments  against  Mediterrannean  Polaris  end 
carrier-borne  nuclear  weapons  were  "sufficient"  (p.  268)  to  justify  a  svap 
of  aid  for  bases.  Forward  basing  of  naval  defenses  against  the  U.S. 
strategic  deployments  offered  the  Soviets,  according  to  Dragnich  (p.  269), 
"a  make-shift  alternative  to  a  larger  and  more  capable  navy." 

Ra'anan  ( SNP ,  ch.  11)  offers  a  novel  account  of  Soviet 
decision-making  in  the  Middle  East.  Ra'anan  argues  that  Soviet  military 
personnel  do  not  come  and  go  at  the  demand  of  client  states,  and  Soviet 
presence  in  client  countries  is  a  consequence  of  Soviet  decisions.  With 
respect  to  Soviet  bases  in  Egypt,  Ra'anan  rejects  (p.  187)  any  notion  that 
Egyptian  initiatives  governed  Soviet  presence.  In  particular,  he  reasons 
that  the  Soviets  foresaw  an  Egyptian  defeat  at  Israel's  hands  in  the 
1970's  and  initiated  withdrawal  to  avoid  a  second  embarrassment.  The 
switch  in  Soviet  policy  from  pro-intervention  in  1970  to  withdrawal  in 
1972  Ra'anan  attributed  (p.  199)  to  waxing  and  waning  influence  of  two 
opposed  Kremlin  factions.  He  gives  Egyptian  actors  virtually  no  role  in 
these  events.  Ra'anan  outlines  (p.  205-6)  a  Soviet  "plan"  for  the  1973 
Middle  East  War,  which  he  suggests  was  formulated  by  Moscow  in  1972  and 
carried  out  by  Egypt  and  Syria. 

Ra'anan  acknowledges  (p.  26)  that  his  "reconstruction  of 
developments"  is  "speculative."  One  commentator  labeled  his  analysis  "one 
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of  the  best  short  stories  of  the  year”  (Kerr,  1975:  99).  Ra'anan 
disregards  the  role  played  by  the  Egyptians  in,  first,  seeking  Soviet  aid 
and  advisors,  and  second,  expelling  the  Soviets  in  1972.  He  also 
attributes  remarkable  foresight  to  Soviet  leaders.  For  example, 
"Brezhnev's  plan,"  according  to  Ra'anan  (p*  205),  includeo  foreseeing  in 

1972  all  of  the  following:  the  coincidence  of  the  Arab  attack  in  October 

1973  and  a  "domestic  or  other  crisis”  which  would  distract  the  United 
States}  the  Israeli  false  alerts  of  1973;  the  Egyptian-Syrian  surprise; 
Israeli  counterattack  successes;  U.S.  reactions  to  Soviet  moves  toward 
intervention;  Egyptian  territorial  gains  in  the  Suez;  and  American 
post-war  diplomatic  moves.  It  is  doubtful  that  this  clarity  of  foresight 
existed  in  the  Kremlin  or  for  Kremlin  scholars.  These  elements  of 
“Brezhnev's  scenario"  are  barely  plausible  even  in  hindsight. 

Kerr  (1975)  disagrees  with  Ra'anan's  analysis  of  the  Soviets' 
influence  on  Egypt.  Kerr  notes  that,  like  the  United  States,  the  Soviets 
have  difficulties  trying  to  translate  aid  into  influence.  The  Egyptian 
conflict  with  Israel  gave  the  Soviets  a  powerful  tool  for  influence  in  the 
form  of  military  aid  and  assistance.  In  the  wake  of  the  1973  war  Egypt 
turned  to  the  United  States  for  diplomatic  aid  which  Moscow  could  not 
deliver.  Kerr  says  virtually  nothing  about  the  role  of  strategic  defense 
or  Mediterranean  bases  in  shaping  Soviet  policy  toward  Egypt.  The  primary 
Soviet  goal  in  Egypt,  according  to  Kerr,  was  to  maintain  their  presence 
and  influence  in  the  region* 

Kerr  rejects  Ra'anan's  thesis  that  the  Soviets  foresaw  the  events 
and  outcomes  of  the  October  1973  war  and  benefited  from  the  war's  results. 
In  contrast,  Kerr  argues  (p*  107)  "it  is  clear  that  the  Soviets  badly 
miscalculated  in  supposing  they  stood  to  gain  anything  from  it  .  ♦  .  their 
client's  relative  success  redounded  not  to  their  benefit  but  to  that  of 
the  United  States.”  Since  war  with  Israel  stood  as  the  primacy  basis  for 
Egypt's  relationship  with  the  USSR,  Sadat's  shift  from  war  footing  to 
peace  offensive  in  the  wake  of  the  October  War  undid  the  Soviets' 
long-term  effort  to  prevent  an  American-backed  status  quo. 

Freedman's  (SNP,  eh.  12)  analysis  of  the  Soviet  Union  and  Egypt 
addresses  the  role  of  both  Egypt  and  the  United  States  in  altering  the 
influence  and  presence  of  the  Soviets,  Freedman  assesses  (p,  215)  Soviet 
reluctance  to  aid  Sadat  before  the  1973  war  as  due  to  unwillingness  to 
“let  themselves  be  further  exploited”  or  to  bo  dragged  into  confrontation 
with  the  United  States.  Soviet  preferences  were  to  maintain  its  presence 
in  Egypt  but  to  prevent  its  Egyptian  hosts  from  seeking  a  military 
“solution”  to  the  Arab-Israeli  problem.  The  ”na~war,  no-peace"  situation 
which  the  Egyptians  found  so  repellent  was  responsible  for  the  Soviets' 
military  presence  and  naval  bases  in  Egypt,  it  was  a  situation  very 
favorable  for  the  Soviets  as  well  as  Israel  and  the  United  States,  but  not 
Egypt,  The  Soviet  expulsion  by  the  Egyptians  was  a  heavy  strategic  loss 
co  the  Soviets,  according  to  Freedman  (p»  218).  Freedman  concludes  <p, 
230)  that  “All  in  all,  the  Soviet  relationship  with  Sadat's  Egypt  has  mt 
been  a  pleasant  or  profitable  one  for  the  Soviet  leadership."  Like 
Rubinstein  (SMFt  179),  Freedman  observes  (p»  230)  that  Egypt  influenced 
and  exploited  the  Soviets  more  than  the  reverse. 

Mainland  (NPSP,  eh.  15)  argues  that  “there  is  little  doubt"  that 
the  Soviets'  immeSTate  objective  in  the  Mediterranean  was  to  Improve  its 
military  capabilities  in  that  region*  But  beyond  that,  Mainland  writes 
<p.  260) 


Why  they  wanted  that  force  in  the  Mediterranean,  and  what 

they  planned  to  do  with  it,  cannot  be  specified  with  any 

certainty. 

Weinland  prefers  the  explanation  (SND:  292-305)  that  the  Soviet  forces  in 
the  area  were  needed  for  strategic  defense  of  the  USSR  against  seaborne 
NATO  nuclear  weapons,  and  could  also  serve  secondarily  to  protect  Soviet 
Interests  in  the  region. 

With  respect  to  the  Soviet  Navy  and  Egypt,  Weinland  (NPSPs  267  ff) 
offers  what  amounts  to  the  converse  of  Ra'acan's  thesis:  a  description  of 
Sadat's  long-term  campaign  to  improve  Egypt's  strategic  and  geopolitical 
power  in  the  region.  Rather  than  a  "Breshnev  Plan,"  as  Ra'anan  offers, 
Weinland  outlines  the  Sadat  Plan  for  manipulating  the  Soviet  presence  to 
achieve  Egyptian  goals.  Weinland  describes  Sadat  as  using  'carrot  and 
stick'  tactics  on  the  Soviets  to  obtain  the  military  aid  and  Independence 
from  Soviet  diplomatic  restraints  that  he  needed  to  reopen  the 
Arab-Israeli  war.  For  example,  the  offer  in  December  1972  to  renew  the 
1968  naval  support  agreement,  which  allowed  the  Soviet  Navy  extensive 
access  to  Egyptian  support  and  repair  facilities  was  a  "carrot."  The 
ejection  of  Soviet  advisors  end  air  defense  personnel  in  July  1972  was  a 
demonstration  of  the  “stick." 

In  Weinland's  account,  the  Soviets'  Mediterranean  squadron  was  a 
Soviet  vulnerability  with  respect  to  Egypt-Soviet  relations.  Its  reliance 
on  shore  support  enabled  Sadat  to  "hold  it  hostage”  and  threaten  to  reduce 
or  eliminate  that  support  if  the  USSR  failed  to  meet  Egyptian  demands.  In 
terms  of  making  points  with  the  Egyptians  by  using  the  squadron  to  protect 
Egypt  from  the  intervention  of  the  U.$»  Sixth  Fleet,  W -inland  suggests  (p. 
269)  the  effort  failed:  “Egypt  was  dissatisfied  with  Soviet  performance 
during  the  war." 

There  is  little  question  that  after  1973  Soviet  influence  in  Egypt 
declined  precipitously*  Weinland's  (NFS?)  analysis  shows  that  the  loss  of 
Egyptian  shore  support  facilities  had  a  dramatic  impact  on  the  Soviet 
Mediterranean  squadron:  the  squadron's  strength  declined,  transits  of  the 
Turkish  straits  declined  (although  transits  of  naval  auxiliaries  remained 
constant),  ship  day  totals  leveled  aff  and  then  declined,  Soviet  naval 
port  calls  increased  to  possible  alternatives  to  Egypt  (Libya,  Syria, 
Yugoslavia). 

At  least  with  respect  to  the  Mediterranean  littoral  states  of  the 
Middle  East,  Weinland's  analysis  suggests  that  Soviet  defensive  missions 
ltd  to  the  need  for  influence  ashore  because  the  fleet  needed  support 
ashore*  when  this  support  was  removed  (as  in  Albania  and  Egypt),  one 
important  component  of  Soviet  influence,  the  Soviets'  Mediterranean  naval 
pretence,  contracted  markedly.  Why  the  Egyptians  removed  that  support 
involved  far  mote  than  the  actions  of  the  Soviet  Squadron,  but  Weinland 
seems  to  argue  that  the  Squadron's  presence  did  little  to  facilitate 
Soviet  influence  in  the  flcut  place,  offered  a  point  of  vulnerability  when 
that  influence  was  weakened,  and  was  a  significant  early  victim  when  the 
influence  was  lost* 

Using  the  case  of  Soviet -Egyptian  relations  to  draw  inferences 
about  Soviet-Middle  Eastern  affairs,  suggest  several  conclusions  about 
estimates  * 

1.  Estimators  who  emphasise  the  influence  of  Egypt  oq  the  Soviet* 
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(Dragnich;  Rubinstein,  1975;  Freedman;  Kerr)  all  note  the  Soviets 
defensive  strategic  needs  for  Mediterranean  naval  and  air  bases  as  major 
motivations  for  Soviet  efforts  at  influence.  Those  estimators  who 
emphasize  only  the  Soviet  influence  (Ra'anan,  Rubinstein,  1980)  find 
Soviet  naval  needs  only  a  minor  factor  in  either  involving  the  Soviets 
with  the  Egyptians  or  shaping  Soviet  influence.  These  latter  estimators 
emphasize  the  Soviet  objective  of  acquiring  influence  in  the  Arab  world. 

2.  The  assessment  of  whether  the  Soviets  exercise  influence  on 
client  states  through  their  naval  presence,  or  at  all,  varies  with  the 
degree  to  which  the  estimator  focuses  on  the  influence  of  the  client 
state:  the  greater  the  focus  on  the  actions  and  goals  of  the  client 
state,  the  less  the  perceived  influence  of  the  Soviets  or  their  navy;  the 
greater  the  focus  on  the  Soviets'  goals  and  efforts,  the  greater  the 
influence  role  perceived  of  the  Soviet  Navy  and  other  diplomatic  or 
military  instruments.  That  is,  influence  follows  a  simple  hydraulic 
relationship;  if  one  party  has  more,  the  other  has  less.  All  estimators 
seem  to  view  influence  as  somehow  constant  and  variously  divided. 

3.  Estimators  who  focus  on  the  Soviets  tend  to  perceive  the 
Soviet  Navy  as  having  posed  an  effective  counter  to  the  U.S.  Navy  in  the 
1973  Middle  East  war.  Estimators  who  focus  on  the  client  states 
(especially  Egypt)  raise  the  possibility  that  clients  saw  the  Soviet  Navy 
as  having  only  limited  influence  on  the  1973  crisis,  and  as  playing  a 
minor  role  in  the  crisis  despite  its  dramatically  expanded  presence  in  the 
Mediterranean. 

Case  4.  Interpretations  of  the  Gorshkov  Scries 

Few  bodies  of  Soviet  naval  literature  have  generated  as  much 
disagreement  as  have  Admiral  Sergey  Gorshkov's  unique  publications  (see 
McConnell,  SKI,  ch.  29  for  a  summary  of  the  publications  and  Che  debate). 
There  seems  to  be  agreement  chat  writings  with  these  details  and  scope  by 
the  serving  Commander-in-chief  of  a  Soviet  armed  service  are 
unprecedented,  that  they  are  extremely  important  for  understanding  both 
Gorshkov  and  the  Soviet  Navy,  and  that  the  debate  over  the  meaning  and 
significance  of  these  unique  writings  shows  no  sign  of  abating.  The 
differences  among  interpreters  of  the  Gorshkov  articles  and  book  are 
extensive  and  can  only  be  briefly  suggested  here:  the  analysis  of  the 
Gorshkov  literature  has  every  indication  of  becoming  a  major  branch  of 
U.S.  naval  intelligence  on  the  Soviet  Navy, 

Commentators  on  the  Gorshkov  writings  include  Herrick  (SND,  ch* 
13),  Hibbitfa  <KFSF,  ch.  !)»  Hudson  (SNO,  ch.  t,  1976) ,  Jameson  (Sfl, 

2),  McConnell  (SSI,  ch*  19),  HeeGuire  (SjjQ,  ehs.  34,36;  SSF,  chps.28,  33; 
j§Ni*  eh*  30),  Thompson  <NgS£*  ehp,  t)»  Vigor  CSNF,  ehs*  I1»7  32),  Vein  land 
?§NP,  ch,  19),  Oil ferenees "between  commentators  range  frees  global  issues, 
sued!  as  the  aothorUsti veness  of  the  Gorshkov  aeries  as  Soviet  naval 
doctrine  (e.g. ,  MecCwire,  S£t»  ch*  30;  McConnell,  §gl»  ch*  19);  to 
interpretations  of  psttieulaiTl&taaei  and  expressions  (e.g*.  Vigor,  SHF, 
eh,  32;  MeeGwire,  SMP,  eh,  33), 

Naval  analysts  do  nut  even  seem  agreed  on  as  simple  and 
straightforward  an  issue  as  the  frequency  of  Gorshkov's  publications 
(e*§,»  "Admiral  Gorshkov  publishes  infrequently,**  Veiniand,  5*7, 
"Gorshkov  hat  published  one  or  morn  articles  in  a  Soviet  military  Journal 
almost  every  year  since  at  least  1963,”  Hibbltts,  HhSPs  1.  Jameson,  STS* 
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31,  characterizes  Gorshkov's  writings  as  "voluminous"). 

Several  commentators  assert  the  hypothesis  that  the  Gorshkov  book, 
The  Sea  Power  of  the  State,  reflects  Soviet  naval  doctrine  (Hibbltts, 
Jameson,  McConnell,  Vigor)"" while  others  Interpret  Gorshkov  as  advocating  a 
new  doctrine  (Herrick,  Hudson,  MccGwire,  Thompson,  Welnland).  Some 
commentators  see  parts  of  Gorshkov's  writings  as  doctrinal  and  other  parts 
as  advocacy  (e.g.,  Hibbltts,  NPSP:  4,  21).  The  latter  analysts  suggest 
Gorshkov  is  espousing  his  side  of  an  ongoing  debate  within  the  highest 
Soviet  Bilitary  and  political  councils  on  the  mission  and  role  of  the 
Soviet  Navy.  The  former  analysts  suggest  the  debate  has  been  resolved, 
Gorshkov  won  his  points,  and  his  series  is  an  authoritative  "concrete 
expression  of  doctrine"  (McConnell,  SNI:  566). 

While  both  sides  on  this  issue  use  an  internal  analysis  of 
Gorshkov's  writings,  the  authoritative  doctrine  school  emphasizes  his  use 
of  "doctrinal  authenticators":  key  words  that  tend  to  be  associated  in 
Soviet  writings  with  military  policy  and  expressions  of  military  doctrine 
(McConnell,  SNI:  566,  604-612).  For  example,  McConnell  (p.  605) 
emphasizes  the  importance  of  the  worda  "unity  of  views"  in  the  editors' 
introduction  to  the  Gorshkov  series  of  articles,  and  that  "this  expression 
ie  a  telltale  indicator  of  military  doctrine  (or  military  policy)  .  . 
Kibbitts  (NPSP:  4)  concurs  in  this  interpretation  of  “unity  of  views." 
McConnell  notes  several  of  these  telltale  indicators  at  critical  points 
(e.g.,  introductions  of  Gorshkov's  writings). 

Analysts  supporting  the  view  of  Gorshkov  as  advocate  or  lobbyist 
for  naval  interests  rather  than  as  doctrinal  spokesman  tend  to  point  to 
the  context  of  Gorshkov's  remarks  as  against  the  content,  frequently 
noting  the  discrepancies  between  what  Gorshkov  obviously  wants  (e.g., 
"balanced  fleet")  and  what  he  has  been  able  to  get  in  his  25  years  as  head 
of  the  Soviet  Navy. 

Since  all  readers  of  Gorshkov  agree  that  he  strongly  supports  a 
balanced  fleet,  and  most  agree  that  the  Soviet  Navy  has  not  been  balanced 
in  the  past,  the  different  interpretations  of  Gorshkov  have  different 
implication*  for  Soviet  shipbuilding,  If  Gorshkov  is  a  spokesman  for 
doctrine,  the  Soviet  fleet  should  be  tending  toward  a  balanced  fleet.  If 
Gorshkov  is  merely  an  advocate,  the  Soviet  fleet  may  remain  unbalanced 
into  the  future.  Or  one  might  agree  with  Gallagher  (SNP:  56)  that 
military  doctrine,  while  authoritative,  is  highly  generalized  and 
ambiguous  and  %  poor  key  to  Soviet  strategic  policy.  In  this  case, 
whether  Gorshkov  is  doctrinal  spokesman  or  advocate  has  little  to  do  with 
Soviet  naval  decisions. 

The  interpretation  of  Gorshkov's  views  on  specific  concepts  may 
have  important  .eplications  for  estimating  Soviet  naval  peacetime 
intentions.  For  example,  Gorshkov's  concept  of  “command  of  the  tea"  has 
been  viewed  in  nitrou  terms  by  McConnell  (SMI:  $99-60!)  as  'creating  a 
favorable  operational  regime"  for  wartime  strategic  naval  offensive  and 
defease  (e.g.*  SIBH  and  aati-AStf  operations).  Vigor  (SNP:  605)  gives  the 
expression  broad  meaning:  complete  removal  of  the  enemy**  fleet  from  the 
naval  theaters  if  war.  Vigor  specifically  interprets  Gorshkov  at  using 
this  expression  to  mean  the  Soviet  Navy  “must  aim  to  acquire  superiority 
of  force  over  ics  enemy  in  the  principle  theater  of  operations  and  be 
strong  enough  in  secondary  areas  to  prevent  him  from  interfering."  vigor 
sets  this  vsaf.s  as  "a  valuable  clue  to  tome  likely  paths  of  future 
development  of  Soviet  naval  strategy." 


36 


MccGwire  (SNP:  631-635)  rejects  these  interpretations  of  Gorshkov 
since  the  phrase  iifraraly  used,  used  in  a  context  that  suggests  Gorshkov 
is  defending  himself  from  charges  of  bein^  a  Mahanist  (i.e.,  advocate  of 
bourgeois  doctrine),  and  Irrelevant  to  the  Soviet  Navy,  which  historically 
has  always  been  concerned  with  the  problem  of  how  to  conduct  naval 
operations  without  command  of  the  sea#  The  concept  of  sea  denial  holds  a 
more  central  role  in  both  Soviet  naval  capabilities  and  doctrine  as  well 
as  in  Gorshkov,  according  to  MccGwire  (p.  634).  It  has  greater  relevance 
to  future  Soviet  naval  strategy  than  sea  command  as  well,  because  the  sea 
denial  strategy  “relies  on  the  use  of  overseas  bases  to  discharge  .  •  . 
war-related  casks  in  peacetime.” 

PRESENT  SOVIET  NAVAL  EVENTS 

Case  5.  Readiness  for  and  Purposes  of  Forward  Deployment 

Two  related  questions  deal  with  Soviet  Navy  forward  deployment: 
how  ready  were  the  Soviets  to  deploy  forward  when  they  did,  and  what 
purposes  were  served  by  forward  deployment?  The  first  is  largely  an 
historical  issue  whiH  the  second  involves  past  as  well  as  present  events 
(i.e.,  the  Soviet  Navy  is  still  deployed  forward,  and  th-.  question  can  be 
raised  as  to  how  the  purposes  of  that  deployment  have  shifted  or  remained 
constant). 

The  various  explanations  of  why  the  Soviet  Navy  deployed  forward 
also  bear  on  whether  the  Soviets  prepared  for  forward  deployment  (and  were 
ready  to  do  so),  or  whether  they  were  unready  for  any  of  several  reasons 
(unprepared  and  unwilling,  prepares!  but  unwilling,  prepared  and  willing 
but  unready  through  chance  circumstances  —  e*g.,  loss  of  bases,  etc*)* 
Griffiths  (SND,  ch*  U  categorises  these  explanations  into  three  schools. 
The  first  sees  Soviet  forward  naval  deployment  as  a  bid  for  control  of  the 
seas  and  the  result  of  an  overall  plan  for  global  projection  and 
intervention  capability.  This  school  holds  an  image  of  Soviet  foreign 
policy  behavior  as  motivated  by  militant  territorial  expansionism  aimed  at 
world  rule* 

The  second  school  Griffiths  perceives  explains  forward  expansion 
as  an  emerging  interest  in  a  limited  capability  for  projecting  Soviet 
influence  in  the  Third  World,  which  developed  along  with  the  defensive 
forward  deployment  aimed  at  countering  Western  sea^basad  strategic  strike 
forces.  As  the  Soviet  Navy  emerged  free  home  waters  to  attempt  the  latter 
task,  the  utility  of  the  former  task  grew  apparent  and  capabilities  were 
first  reoriented  and  then  perhaps  specifically  developed  to  deal  with  the 
protection  of  Soviet  stats  interests  in  the  Third  World,  This  goal  of 
limited  projection  Griffiths  associates  with  a  motive  of  limited  political 
(rather  than  territorial)  expansionism  —  “Hnseow  eon  he  expected  to 
advance  its  power  and  influence  whenever  given  the  opportunity!  but  when 
the  opportunity  is  denied,  the  Soviets  are  likely  to  behave  with  prudence” 
(p.  13) « 

The  third  school  Griffiths  terms  “protective  reaction*  —  Soviet 
forward  deployment  it  teen  m  an  essentially  defensive  response  to  the 
Western  sea^feased  strategic  forces*  This  school  sees  neither  a  soviet 
interest  l«  nor  any  considerable  capability  for  an  offensive  political  use 
of  seapowev.  The  Soviet  motive  is  reluctant  expansionism,  she  result  of 
strategic  insecurity  and  fear  rather  titan  ambit  ions  for  power  and 


37 


influence.  Veetecn  moves  force  the  Soviets  to  teke  reluctant  and  cautious 
moves  in  self-defense. 

Each  of  these  schools  is  excessively  narrow  and  simplistic! 
according  to  Griffith,  and  each  is  inadequate  to  explain  Soviet  forward 
deployment.  Griffiths  believes  this  is  particularly  so  of  the  first 
school.  In  lieu  of  any  one  school,  Griffiths  suggests  Soviet  foreign 
policy  (and  naval  forward  deployment)  results  from  the  competition  within 
the  Soviet  Union  of  "limited  projection**  and  Hprotective  reaction'* 
interests*  These  "conflicting  trends  in  Soviet  behavior"  (p.  14)  as  well 
as  situational  (i.c.,  non-Soviet)  variables  influence  Soviet  foreign 
policy  and  forward  deployment. 

The  first  school  implies  a  readiness  for  forward  deployment:  as 
part  of  the  overall  plan  for  control,  the  Soviet  Navy  would  be  prepared 
for  its  role.  The  Navy  would  no?  move  forward  until  ready  because  of  the 
possibility  that  a  lack  of  capability  or  will  on  the  naval  front  might 
upset  the  overall  plan*  Inasmuch  as  this  viewpoint  envisages  no  pressures 
on  the  Soviets  to  deploy  before  they  are  ready,  and  since  premature 
deployment  might  produce  penalities  for  the  overall  plan,  it  io  likely 
that  this  school  would  require  that  the  Soviet  Navy  be  fully  ready  for  all 
major  missions  when  it  emerged  on  the  high  seas.  Any  reflections  of  major 
unreadiness  to  execute  essential  missions  would  be  inconsistent  with  a 
Soviet  overall  plan  for  control  of  the  seas.  Inasmuch  as  the  Soviet  Navy 
could  (perhaps)  be  optimally  designed  against  the  existing  Western  fleets 
now  in  being  on  the  world  seas,  as  U.$.  Chief  of  Naval  Operations  Zumualt 
once  hypothesised,  there  would  be  little  reason,  given  the  first  school 
argument,  for  the  Soviet  Navy  to  move  forward  before  it  was  ready. 

In  neither  the  "limited  projection"  nor  “protective  reaction" 
schools  is  it  necessary  that  the  Soviet  Navy  be  ready  prior  to  forward 
deployment  or  even  now.  both  schools  presuppose  the  requirement  for 
forward  deployment  was  imposed  by  the  Western  strategic  threat  to  the 
USSR,  and  required  some  demonstration  by  the  Soviets  even  if  they  were 
unready  to  fulfill  all  the  necessary  missions. 

Dismuke*  and  McConnell  (1970,  eh.  8)  offer  a  variant  of  the  first 
and  second  schools  outlined  by  Griffiths.  While  Oiamukes  and  McConnell  do 
not  see  Soviet  ambitious  ••  extending  to  world  sea  control,  they  do 
attribute  Soviet  forward  naval  deployment  to  an  overall  plan  aimed  at 
coordinating  Soviet  foreign  policy  instruments  (trade,  aid,  diplomacy, 
etc  )  for  expanded  Soviet  influence  in  thu  Third  World.  This  plan  (or 
"davelepwtni  strategic#  for  long-term  goal#"  a*  ©ienukes  and  McConnell 
characterise  them),  formulated  between  1911  and  19$$»  laid  down  the 
guidelines  for  "basic  continuities  of  policy,**  including  naval 
construction  and  operations,  that  extend  up  through  today.  The  decision* 
for  construction  of  an  "ocean-going"  fleet  were  made  in  195*  to  provide 
the  capabilities  for  coercive  military  and  naval  diplomacy.  The  Initial 
target  of  thie  plan  was  to  develop  a  counter  to  the  U.S.  attack  aircraft 
carriers,  which  posed  both  a  strategic  threat  aa  well  a»  a  counter  to 
Soviet  activism  in  the  third  World. 

Uiamukes  and  McConnell  seem  to  have  in  mind  a  hybrid  of  the  first 
two  school*  Griffiths  outlined,  they  see  forward  deployment  as  part  of  a 
long-term  Soviet  strategy  (first  school)  rather  than  as  an  interest  that 
emerged  with  experience  (second  school).  Go  the  other  hand,  they  see  the 
Soviets  a*  interested  in  projection  of  power  in  the  third  World  (second 
school)  rather  than  world-wide  sea  control  (fleat  school),  finally*  they 
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see  the  Soviets  as  Interested  in  expanding,  defending,  and  preserving 
"state  Interests"  abroad  (second  school)  rather  than  aimed  at  territorial 
expansion  and  world  rule  (first  school). 

They  also  argue  that  the  Soviets  were  quite  unprepared  for  their 
first  foray  into  coercive  naval  diplomacy,  exercised  on  behalf  of  Syria  in 
1957  (Dtsraukes  and  McConnell:  7-10,  282).  The  Soviets  quickly  recognized 
their  unreadiness,  according  to  this  account,  and  i'oresook  any  subsequent 
attempts  at  coercive  naval  diplomacy  until  the  mid-1960s,  when  the  surface 
ship  capabilities  dictated  by  the  1954  decisions  emerged  from  the 
long-term  construction  programs. 

Obviously,  Dismukes  and  McConnell's  case  for  a  long-term  plan  for 
a  coercive  naval  diplomacy  in  the  Third  World  rests  in  part  on  the  exact 
nature  of  the  1954  naval  ship-building  decisions.  The  differences  of 
opinion  on  this  issue  are  discussed  above  under  Case  1.  It  is  even  more 
important  to  their  argument,  however,  that  the  Soviet  Navy  be  ready  in  the 
mid-1960s  for  forward  deployment.  Since  this  forward  move  is  seen  as  part 
of  the  long-term  plan,  it  would  be  inconsistent  for  the  Soviets  to  make 
the  mistake  twice  of  deploying  forward  for  coercive  naval  diplomacy 
without  having  the  necessary  capabilities.  The  first  test  of  the  Soviet 
Navy's  readiness  for  this  long-planned  role  came  in  June  1967  with  the 
Six-Day  War. 

Were  the  Soviets  ready  in  1967  to  counter  the  Sixth  Fleet's  task 
groups  and  prevent  them  from  intervening  in  the  Six-Day  War  (as  the 
Soviets  and  their  friends  consistently  claimed  after  this  interpretation 
was  raised  in  the  West  in  the  aftermath  of  the  war)?  Dismukes  and 
McConnell  (pp.  1 59-168)  make  the  case  that  the  Soviet  deployments  were 
significantly  different  in  the  crisis  period  than  in  the  previous  three 
years  of  Soviet  Mediterranean  opperations  in  the  following  four  ways:  the 
size  of  the  Mediterranean  squadron  increased  dramatically  (ship  days  and 
daily  average  strength  in  196?  were  nearly  double  the  1966  levels, 
Weinland,  MPSP:  262);  foe  the  first  time  Soviet  combatants  (destroyers) 
were  given  the  "tattletale"  mission  of  observing  and  following  U*S,  attack 
carriers  (this  task  had  heretofore  been  the  duty  of  slower,  noncoobatant 
intelligence  auxiliaries);  the  Soviets  mounted  an  air  and  sealift  to  the 
Arab  states;  and  they  indicated  they  were  considering  direct  military 
intervention  (probably  with  Airborne  Troops)  if  the  Arab  capitals  were 
threatened  by  Israeli  ground  forces. 

Although  this  evidence  makes  an  excellent  case  for  a  change  in 
Soviet  naval  crisis  behavior,  it  does  not  reflect  a  readiness  to  actually 
counter  the  U.s.  Sixth  Fleet,  Several  pieces  of  evidence  suggest  the 
Soviet  Mediterranean  units  were  not  ready  or  capable  of  preventing 
intervention  by  the  H4»  carriers. 

Although  Soviet  ship*  elsewhere  in  the  world  were  intensively 
harrassing  tt.S.  Navy  ships  (e.g,,  in  the  Sea  of  Japan  sn  May  10  and  U 
196?)  the’  Soviet  ships  avoided  any  actions  §f  this  type  in  the 
Mediterranean  during  the  crisis.  The  combatants  on  tattletale  duty  tended 
to  stay  beyond  their  weapons0  ranges  ttam  the  carriers,  and  only  once  did 
a  Soviet  destroyer  take  up  a  parallel  (i*@* ,  firing  course)  near  a 
carrier*  Soviet  navel  contact  with  Western  naval  forces  was  limited 
almost  entirely  to  these  prudent  and  circumspect  tattletale  operations. 
Most  of  the  Soviet  combatants  remained  anchored  veil  away  fraa  the  Western 
carriers  or  the  Arab-israeii  fighting.  The  Soviet  squadron  in  the 
Mediterranean  throughout  the  crisis  was  snail  relative  to  the  black  Sea 


Fleet  (e.g.,  the  Soviets  never  had  more  than  two  surface  to  surface 
missile  (SSM)  destroyers  cr  one  cruise  missile  submarine  in  the 
Mediterranean  during  the  crisis,  although  there  were  four  SSM  destroyers 
in  the  Black  Sea  Fleet  and  the  Fleet's  one  SSM  cruiser  did  not  leave  the 
Black  Sea  during  the  crisis  (Dismukes  and  McConnell:  161-2).  Xn  the  wake 
of  Soviet  threats  of  10  June  to  Intervene,  President  Johnson  sent  U.S. 
carriers  toward  the  Syrian  coast.  Soviet  tattletales  followed  but  no 
action  was  taken  to  Interpose  Soviet  warships  between  this  intervention 
threat  and  the  Soviets'  clients. 

blsmukes  and  McConnell  <p.  167)  conclude  of  this  initial  trial  of 
Soviet  coercive  naval  diplomacy  that  “The  Soviets  probably  came  away  from 
the  1967  war  with  opinions  confirmed  about  how  to  deploy  effectively  to 
ths  Mediterranean  during  crises. “  Xn  contrast  to  this  favorable  (to  the 
Soviets)  assessment,  MccCwire  (SND:  344)  concludes  the  Soviets  were 
unready  for  this  forward  deployment  to  the  Mediterranean: 

...  it  is  by  no  means  clear  that  the  political  gains  from 
this  Soviet  presence  outweigh  the  various  unfavorable 
reactions  to  the  introduction  of  a  superpower  confrontation 
to  the  area,  to  shortfalls  in  the  support  of  client  states, 
or  to  the  imperialist  overtones  of  naval  power.  Meanwhile, 
the  early  deployments  were  dangerously  exposed,  and  in 
hostage  to  the  West. 


Xf  Dismukes  and  McConnell  represent  a  hybrid  of  Griffiths'  first 
two  schools,  MccGwire  ($ND,  ch.  25)  represents  a  “pure  version"  of  the 
second  school.  He  perceives  (p.  350)  the  Soviet  Navy  as  drawn  out  into 
forward  deployment  by  initially  the  increased  range  of  U.S*  carrier-borne 
•trike  forces  and  secondarily  by  the  Polaris  deployments? 

this  generated  the  third  and  most  far-reaching  change  in 
Soviet  naval  policy,  involving  the  extension  of  maritime 
defense  zones  and  a  shift  to  forward  deployment. 

Neither  the  use  of  Soviet  naval  presence  to  influence  Third  World  events, 
nor  the  use  of  naval  capabilities  to  inhibit  intervention  by  the  Sixth 
Fleet  were  sufficiently  important,  or  guaranteed  of  success  to  have  been 
major  causes  of  the  shift  to  forward  deployment  in  the  Mediterranean, 
according  to  HccGwire  (p.  351).  lie  argues  that  the  1954  decisions  did 
nothing  to  enhance  capabilities  for  these  missions ,  and  favorable 
opportunities  for  adopting  these  policies  were  neglected  in  1954*1960.  tie 
•tea  the  Mediterranean  deployment,  when  it  came  in  1963-64,  as  placing  a 
considerable  strain  on  Soviet  naval  resources  just  to  accomplish  the 
strategic  defensive  mission#  and  leaving  little  or  no  surplus  for  naval 
diplomatic  missions.  As  the  number#  of  units  on  forward  deployment 
increased  in  1967-63  “the  opportunities  for  the  political  exploitation  of 
theft  presence*  also  increased. 

KccGwire  views  the  Soviet  Havy  as  having  deployed  forward 
basically  unready  to  execute  its  strategic  defensive  mission,  the  need  to 
counter  the  Western  threat  forced  the  Soviets  to  "‘forego  ,  *  »  the  basic 
naval  requirement#  of  survivability*  and  the  only  counter  the  Soviet  fcavy 
posed  for  Western  strategic  systems  in  this  initial  phase  of  forward 
deployment  required  Che  protection  of  peacetime*  the  Soviet  havy  was 
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incapable  of  surviving  war  beyond  the  first  salvo  during  this  first 
forward  deployment. 

The  thesis  that  the  Soviet  Navy  was  drawn  into  the  Mediterranean 
by  the  carrier  and  Polaris  threat  is  also  advanced  by  Smoiansky  and  Joynt 
( SNDt  364).  The  coincidence  of  the  loss  of  submarine  facilities  in 
Albania  (1961)  and  the  deployment  of  U.S.  SSBNa  (i960)  posed  a  severe 
problem  for  the  Soviets.  The  initial  Polaris  deployment  in  the 
Mediterranean  in  1963  was  followed  by*  SovietT*proposals  to  make  the  area  a 
nuclear-free  zone  and,  in  1964,  by  the  first  continuous  deployment  of 
Soviet  naval  ships  in  the  Mediterranean.  In  June  1963  the  Soviets 
upgraded  their  six-year  old  military  aid  agreement  with  Egypt  and  began 
deliveries,  for  the  first  time,  of  modern  first-line  equipment.  Between 
1963  and  196?  the  Soviets  brought  intense  diplomatic  pressure  on  Rgypt  to 
allow  Soviet  naval  ship  access  to  Egyptian  facilities.  Smoiansky  and 
Joynt  conclude  (p.  364)  that  Khrushchev's  1964  tour  of  Egypt  was  'prompted 
in  part  by  his  determination  to  obtain  a  naval  base  for  use  of  the  Soviet 
Mediterranean  squadron,** 

Khrushchev's  involvement  in  the  Middle  East  despite  difficulties 
and  setbacks  (e.g.,  loss  of  support  facilities  in  Albania,  Egyptian 
unwillingness  to  grant  wide  access  to  facilities)  is  seen  by  Smoiansky  and 
Joynt  as  responding  to  “the  imperative  of  U.S.  naval  deployment  in  the 
Mediterranean,**  The  “local  war  doctrine14  adopted  by  Brezhnev  and  Kosygin 
represented  a  continuation  of  Khrushchev's  policy,  perhaps  in  a  lower  key 
in  the  Mediterranean,  but  in  a  more  vigorous  form  elsewhere  (e.g.,  the 
greatly  expanded  Soviet  aid  to  North  Vietnam  in  1965). 

Khrushchev's  actions  are  consistent  with  the  thesis  that  he  was 
forced  into  forward  deployment  by  the  Western  strategic  threat  and  was 
unwilling  to  commit  the  Soviet  Navy  to  the  mission  of  supporting  Third 
World  clients  because  of  its  unreadiness,  Khrushchev  turned  down  such  a 
•equest  from  Nasser  during  the  1953  crisis  following  the  Iraqi  revolution 
with  the  explicit  explanation  that  the  Soviets  were  not  ready  for  a  clash 
with  the  West  (see  Oisaukes  and  McConnells  p,  U-U).  As  late  as  196?  the 
legacy  of  Khrushchev's  policy  could  fee  seen  in  the  failure  of  Soviet  naval 
units  to  do  more  than  follow  o,8,  carriers  and  patrol  the  supply  lines 
that  delivered  Soviet  equipment  after  the  fighting  to  replace  the  Arab 
losses.  The  Soviet  explanation  that  their  naval  units  inhibited  Western 
intervention  in  196?  was  constructed  post  hoc  in  the  wake  of  Western 
reactions  to  Soviet  forward  deployment  Uf .  Her  Swire,  SMjn  193,  203-4, 
539-40) »  . 

fUTUfcS  SOVIET  NAVAL 

6,  .  trends  ..Aft.. Anti-Carrier  Warfare  (,&€&)  ..CaRafeililifa.  and  aperationi. 

The  analysis  of  Soviet  naval  diplomacy  fey  Uisnukes  and  Metoaneil 
<19?9)  view*  the  Soviet  Navy  as  Increasingly  engaged  in  eee reive  power 
projection  in  the  Third  World,  At  the  center  of  this  strategy  is  the  need 
to  present  an  effective  peacetime  counter  to  9*$»  aircraft  matt leva* 
HcCOaaell  (in  Oisouke*  sad  McConnell;  21)  write*: 

The  cote  of  Moscow's  third  World  diplomacy  of  force. He*  in 

it*  capabiiifio*  foe  countering  U.S.  carrier  took  group*. 
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These  ACW  forces,  according  to  seyeral  writers,  are  comprised  of  a 
cruise-missile  submarine,  several  torpedo  submarines,  a  surface-to-surface 
missile  (SSM)  ship  and  a  surface-to-air  missile  (SAH)  ship*  McConnell 
views  (p»  13)  surface  ships,  in  particular  SSH  and  SAM  ships,  as  “integral 
parts  of  Soviet  anticarrier  task  groups.*1  In  fact,  as  noted  above,  gun 
cruisers  and  destroyers  are  also  found  In  ACW  teak  groups. 

During  crises,  the  Soviet  Navy  appear.,  to  deploy  a  number  of  ACW 
task  groups  equal  to  the  number  of  Western  carrier  groups  in  the  area. 
These  deployments  seem  to  be  oriented  more  to  crisis  than  wart  e.g., 
while  ACW  units  are  Introduced  to  the  crisis  area,  on  occasion  ASM  units 
have  withdrawn  (Dismukes  and  McConnell:  29. )»  The  ships  the  Soviets 
introduce  to  the  crisis  area  are  usually  those  designed  for  the 
anti-carrier  task,  according  to  Dismukes  and  HcCeoneli  (p.  294)  and 

.  *  .  are  intended  to  counter  the  carriers'  psychological 
impact  and  to  reduce  U.S,  freedom  of  action  in  employing  its 
carrier  forces. 

Soviet  naval  authorities  make  similar  claims  for  their  intentions  during 
crises. 

An  extreme  case  of  this  deterrent  role  for  Soviet  ACW  occurred 
during  the  Angolan  crisis,  argue  Dismukes  and  McConnell  (pp.  148-50,  259), 
when  a  Soviet  ACW  task  group  in  the  South  Atlantic  anticipated  a  possible 
move  southward  of  a  U.S.  carrier  group  and  moved  to  interpose  itself  on 
the  carrier's  route  to  the  crisis  area.  Dismukes  and  McConnell  view  this 
as  a  unique  instance  of  the  Soviets*  use  of  an  ACW  group  to  discourage 
deployment  of  (JSN  forces  in  anticipation  of  U.S*  moves  (Her tog,  NPSP:  41, 
concurs  in  this  essessae-t)* 

Dismukes  and  McConnell  acknowledge  (p.  244)  that  ACW  units  are  now 
some  of  the  older  elements  in  the  Soviet  fleet,  but  view  this  as  a  virtue, 
making  them  cheap  counters  to  the  carriers  in  crises,  and  expendable  units 
for  the  wartime  mission  of  destroying  the  carriers  in  the  opening  salvo. 
The  ACV  task  groups  are  still  the  '‘core  of  Moscow's  Third  World  diplomacy 
ef  force**  (p.  2i>, 

other  naval  analysts  seem  to  agree  that  while  the  Soviet  surface 
unit*  formerly  played  the  ACW  role  outlined  by  Dismukes  and  McConnell,  the 
wartime  anti-carrier  task  now  is  performed  by  a  coordinated 
•ubmarint-Aieefaft  team.  The  use 'of  surface  ships  in  ’the  ACW  role  in  the 
early  1966s  provided  Soviet  designers  and  shipbuilders  the  breathing  space 
needed  to  develop  space-borne  surveillance  and  communications  platters*. 
Soviet  Naval  Aviation  (SNA)  aircraft,  and  nuclear  submarines  for  thu  ACW 
task,  while  surface,  design  and  construction  consent  rated  on  upgrading  the 
MW  capab ilitfda  in  nsw  major  types  (fteriseg,  ifg§g:  43-49).  While  Hefsoi 
agrees  shat  the  Kettles ,  kyndas ,  and  Steal*  l»  wife  designed  fo#  the  ACW 
role,  ha  write*  tp*  49)  that  in  the  <&id-to-i*te-t960* 

Thu  Soviet  Navy  had  effected  the  transfer  of  the  aotiship 
mission  (including  ACW)  ,  to  the  suUufctlme  forte. 

The  heart  of  the  new  A£W  team  is  the  C-cIass  nuclear  %u be* tine  with  the 
5S-N-7  cruise  missile  .and  the  Backfire  bomber.  Ail  of  the  Soviet  flawy  *e 
new  major  surface  unit*  (rtest*  its,  katas,  krivaks)  are  Asw  rather  thr.n 

AOi  abipa,  end  Write*  Ueraog  (p,  53),  “designed  to  operate  under  the 
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umbrella  of  SKA,  i.e.,  tn  the  (Soviet)  SSBN  sanctuaries.** 
eh.  9,  advances  a  similar  concept.) 

Analysts  of  Soviet  warship  construction  trends  ana  designs  concur 
in  Herzog's  assessment  of  the  shift  of  the  ACW  mission  from  the  surface 
unite  to  a  submarine-SNA-suteillte  team  (o.g.,  HecGwire,  NjPSP:  eh.  5). 
For  example,  MccCwire  notes  (p.  98)  the  increasing  clear  separation  of 
Soviet  naval  construction  into  those  units  designed  for  distant  water 
operations  and  those  intended  to  operate  within  the  home  fleet  areas. 
From  1966  onwards  the  surface  programs  “have  been  tailored  to  the 
antisubmarine  role"  (p.  100). 

These  shifts  leave  the  Soviets'  “core**  naval  forces  for  peacetime 
power  projection  in  an  anomalous  position.  On  the  one  hand  the  older 
Kotlins,  Kynrias,  and  Kresta  Is,  are  designed  for  ACW  and  still  effective, 
"but  are  aging  counters  to  U»S*  carriers.  On  the  other  Hand,  the  new 
Soviet  surface  units  are  less  effective  counters  to  carriers  in  combat, 
being  designed  for  ASM  and  requiring  SNA  air  cove* ,  but  these  are  the  most 
effective  new  Soviet  surface  ships  for  distant  deployments*  While  these 
units  may  have  been  designed  with  Third  World  political  missions  in  mind 
<cf.  Herzog,  NPSP:  55),  their  capability  as  ACW  forces  is  probably  more 
psychological  than  tactical;  possibly  impressing  the  naive,  but  otherwise 
more  hostages  than  counters  to  U.S,  carriers*  The  fact  that  the  Soviets 
withdraw  these  newer  forces  into  sanctuaries  as  crises  evolve,  and  replace 
them  with  older  ACM  units,  implies  that  the  Soviets  themselves  are  aware 
of  these  anomalies* 

Friedman  (NPSP,  ch.  l i)  points  out  that  the  evolution  of  the 
Soviet  Navy's  sea  denial  doctrine  dictates  the  eventual  assignment  of  the 
ACW  task  to  more  efficient  and  mobile  air  and  submarine  forces*  The 
drawback  of  this  strategy  is  that,  for  application  at  great  distances  from 
the  Soviet  homeland,  foreign  air  and  submarine  bases  are  required. 
Foreign  bases,  however,  pose  problems  of  sea  control  which  are  not  easily 
solved  with  a  sea  denial  force*  Sea  denial  doctrine  also  prohibits 
surface  concentration  of  forces?  §§£  geographical  concentration  provides 
a  tempting  target  for  a  preemptive  strike*  "As  tension  increases, “ 
Friedman  writes  Cp*  119)  "the  {Soviet)  ships  must  disperse?  they  cannot 
present  neutrals  with  an  image  of  Increasingly  eontintrated  strength***  An 
impressive  "crisis  presence"  is  Inconsistent  with  a  sea  denial  dostrine, 
risking  too  many  forces  In  one  area  to  a  preemptive  blow* 

tbs  analysis  of  Soviet  open-oeean  navi  I  isos  by  banlei  fHfgg:* 
eh*  11)  also  tends  to  reflect  the  shifting  role  of  th®  surf-age  units  ttm 
&€M  to  ASM  tusks*  itp  until  Xi'tX  ACM  strike  activities  were  the  major 
portion  of  these-  exercises.  Since  i$H  she  emphasis  shifted  feamTstee  ASM 
strike  phase  to  strike  coordination,  and  tram  if 14  on,  to  the 
reconnaissance  and  surveillance  phases  and  a  greater  concentration  on  a 
"buildup  of  tensions"  scenario*  In  the  gkean  f%  esefclse,  ACM  strikes 
were  conducted  primarily  by  aircraft,  possibly  aided  by  submarines*  tn 
If  15  ASM  became  the  @alo  these  of  ma  jor  Soviet  naval  werci-aes,  and  seem-s 
to  have  figured  as  the  sain  these  since*  Saniel  concludes  ^p*  251)  that 
"Soviet  earned tmient  s©  the  ASM  grstble**  is  just  as  stif&ejg  if  not  stronger 
than  eamnltisent  to  ACM  "  Since  the  Soviets  take  no  ggeclai  pains  to 
conceal  the  surface  and  air  aspects  of  their  major  open^-acean  es^rtisee, 
and  even  draw  world  attention  to  the®,  it  can  be  assumed  that  they  see  ns 
steed  t©  conceal  the  shift  ©f  the  wartime  ASM  mission  frnn  the  surface 
forces.  Mhete  this  leaves  the  Soviet  Savy's  Third  World  diplomacy  of 
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force  capability  relative  U.S.  carriers  la  still  aa  open  question. 

Case  7:  Soviet  Naval  Support  for  Third  World  Coups 

Naval  analyses  differ  significantly  on  the  role  played  by  the 
Soviet  Navy  in  Third  World  coups:  some  seeing  the  Soviets  as  behaving 
very  circumspect ly,  aiding  only  the  status  quo  powers;  while  others  see 
the  Soviet  Navy  as  having  actively  assisted  in  the  overthrow  of  incumbent 
regimes*  One  example  of  such  differences  involves  the  role  of  the  Soviet 
Navy  in  the  1969  Libyan  coup. 

Jameson  (in  STS:  66)  claimed  a  central  role  for  the  Soviet  Navy  in 
that  coups  ' 

The  (Soviet}  Mediterranean  Squadron  was  notably  employed  in 
an  exercise  of  Soviet  diplomatic  support  (or  so  it  appeared) 

.  .  .  during  the  ...  coup  against  King  Idris.  Soviet, 
Syrian,  and  Egyptian  military  units  were  engaged  in 
maneuvers  involving  a  practice  landing  on  the  Egyptian  coast 
close  to  the  Libyan  border.  The  Mediterranean  Squadron  was 
strung  out  between  the  Egyptian  coast  —  very  close  to  the 
Libyan  border  **-  and  the  Island  of  Crete  in  a  disposition 
apparently  aimed  at  preventing  the  penetration  from  the 
Western  Mediterranean  of  a  hypothetical  U.S.  carrier  task 
force.  The  precise  relation  of  ths  timing  of  this  exercise 
to  the  coup  is  impossible  to  identify,  but  it  seems  highly 
likely  that  some  sort  of  coordination  took  place.  The  most 
significant  force  in  Libya  to  prouet  the  King's  gave  meet  t 
*  .  ,  was  a  British  tank  detachment.  .  .  The  crews  of  thpse 
tanks,  however,  were  in  Cyprus.  To  fly  them  to  Libya  would 
have  required  that  the  transport  aircraft  overfly  a 
substantial  part  of  the  Soviet  squadron,  which  was  bristling 
with  *urface«to*<iif  missiles* 

On  September  26,  1969,  Sadie  Cairo  commented  on  the  Libyan 
coup  as  follows s  “the  presence  of  the  Soviet  fleet  at  this 
strength  It  a  guarantee  for  neutralising  the  effectiveness 
of  the  SiSEth  fleet  and  deterring  it  from  carrying  out  new 
imperialist  adventures** 

tterseg  (KP5P;  40)  ogress  with  Jameson's  view. 

Siechman  (I9??s  2J>  *ugg#«t*  that  Soviet  intervention  in  this  coup 
existed  only  in  the  eyes  of  the  Arabs: 

«. 

Whether  the  United  and  its  fillet- Wit*  actually 

constrained  say  he  less  important  than  whether  other  fetish* 
believed  the®  to  have  been  so  hampered*  for  example,  had  in 
Tripoli  claimed  that  Soviet  naval  operations  deterred 
British  intervention  following  the  coup  d'etat  in  Libya  in 
1969.  So  point  of  fact,  Britain  and  the  Lotted  States 
controlled  air  bases  in  Libya  at  the  time  and  would  net 
necessarily  have  had  to  intervene  by  sea  even  if  the  Soviet 
Lotos  had  Interposed  m  force*  Moreover,  the  Soviet  Seioe 
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itself  has  not  claimed  credit  for  tbla  “defeat"  of  the 
imperialists* 

McConnell  and  Uismukes  <1979,  24}  reject  not  only  a  Soviet  naval 
involvement  in  the  Libyan  coup  but  in  any  coup: 

The  USSR  has  never  made  a  shoo  of  force  in  support  of  a 
successful  coup  against  an  established  government  before 
time  has  proven  the  new  regime's  control  and  thus  the 
emergence  of  a  new  status  quo. 

Despite  charge.,  to  Che  opposite  effect,  we  find  no  evidence 
of  a  Soviet  show  of  force  on  the  morrow  of  the  overthrow  of 
King  Idris  in  Libya  in  1969,  nor  during  the  same  year's 
successful  coup  d'etat  in  Somalia. 

In  their  book  on  Soviet  naval  diplomacy,  Disaukes  and  McConnell 
(1979)  include  a  special,  case  study  by  Roberts  of  the  "nonsense"  of  Soviet 
coercive  diplomacy  in  the  Libyan  coup.  Roberts  reviews  the  evidence  for 
cite  case  that  the  Soviet  naval  presence  off  Libyan  shares  was  coup  related 
and  the  evidence  that  these  activities  were  independent  of  the  coup*  for 
example,  the  exercise  planning  preceded  the  coup  by  months;  the  coup 
itself  occurred  during  a  standdown  in  the  exercise j  there  were  no 
political  connections  between  eh©  Libyan  plotters  aud  the  Soviets*  uibyan 
mi  Soviet  relations  remained  cool  after  the  coup. 

Roberts  proposes  the  count erhypothes is  that  the  Libyan  plotters 
may  have  taken  advantage  of  the  Soviet  exercise  to  shield  the  coup  attempt 
from  possible  intervention  by  the  United  states  or  Britain.  This 
eounterhypt thesis  also  depends,  however,  on  the  action  that  Soviet  ships 
posed  an  effective  SAId  barrier  between  Libya  and  a  Stilish  airlift  or  the 
U.§*  Sixth  fleet*  The  British  and  American  airfield  forces  In  Libya  could 
hav§  assisted  the  king,  however,-  with  no  intervention  from  the  *«&. 
further,  the  Soviet  “exercise'  screen  would  have  stopped  a  British  airlift 
os?  §  Sixth  fleet  sortie  only  if  the  Soviets  were  willing  to  go  from  an 
"’exercise*  to  a  war  footing  on  a  moment**  notice.  Since  Roberts  is 
arguing  that  the  Soviets  had  m  inkling  of  the  coup*  It  is  incredible  that 
doting  an  exercise  Soviet  forces  uml.i  destroy  Sritlsh  aircraft  or  U*S* 
ships*.  In  any  event,  Roberts  suggests  the  plotters  may  not  have  even  been 
aware  of  the  Soviet  naval  activities  before  the  coup*  Gaddafi's  group  nay 
have  exploited  the  Soviet  presence  only  after  the  fast,  as.  hleehfean 
suggested  * 

Ms&okei  and  fiftSonnell  f  If  ?§)  review  several  episodes  in  which 
Soviet  naval  forces  apparently  acted  in  support  el  post^e&up  regimes 
{«,§♦*  Somalia,  lf$t}  #ninea,  iftSi  sierra  Leone,  I0i),  There  Is  no 
convincing  evidence  @f  Soviet  naval  intervention  prior  to  a  coup  in  the 
Third  UerlfU  Mawever,  the  active  role  §■#  the  Soviet  Army  in  the  !#!§  and 
ifTf  AfghaMstan  eoops  nay  indicate  a  change  that  will  affect  Soviet  navel 
act funs  in  the  future* 

Caae  JN  Soviet  freeenae  in  fehe_..Mii*an  Ocean 

virtually  ail  naval  analyst*  memtinm  political,  ocM-oMe.  and 

dipieasatSe  factors  as  motivating  the  Soviet  presence  in  the  Indian  Ocean. 


However,  analysts  give  sharply  different  emphases  to  these  factors,  and 
include  different  behaviors  in  these  broad  categories.  For  example,  some 
analysts  stress  strategic  military  defense  as  the  primary  reason  for  the 
Soviets'  entry  and  presence  (Jukes,  SNP,  ch.  16;  MccGwire,  SND,  ch.  30; 
Smolensky,  SND,  ch.  29;  SNP,  ch.  14).  Other  analysts  stress  diplomatic 
and  political  factors  (Calhoun  and  Petersen,  NPSP ,  ch.  13;  Disraukes  and 
McConnell,  1979;  Graham,  NPSP,  ch.  16;  Kelly,  SNP,  ch.  15;  McConnell,  SND, 
ch.  28;  McConnell  and  Kelly,  SND,  ch.  31).  Most  analysts  mention  trade 
and  economics. 

Differences  among  analysts  include  such  basic  questions  as  whether 
the  Soviets'  move  into  the  Indian  Ocean  is  a  "drive  for  warm  water  ports” 
(Graham,  NPSP:  275;  Herzog,  NPSP:  39).  Herrick,  (1968:  143),  in  contrast, 
claims: 

...  no  evidence  has  been  uncovered  to  support  (but  much  to 
controvert)  allegations  that  the  Soviet  Russians,  like  their 
Tsarist  predecessors,  are  subject  to  an  historic  and 
lemming-like  urge  to  the  sea  to  obtain  warm  water  ports- 

Jukes,  MccGwire,  and  Smolansky  all  emphasize  the  military  purposes 
served  by  the  Soviet  Navy  in  the  Indian  Ocean,  esp?cially  with  respect  to 
the  strategic  ASW  and  ACW  missions.  The  Polaris  submarines,  with  the  A3 
missile  introduced  in  1964,  can  strike  most  of  the  Soviet  Union  from  the 
Arabian  Sea  in  the  Northwest  Indian  Ocean.  Similarly,  the  possibility  of 
strikes  from  U.S.  aircraft  carriers  in  the  Persian  Gulf  against  Soviet 
central  Asia  poses  a  strategic  defensive  problem. 

Jukes  and  MccGwire  also  note  the  role  of  Soviet  space  systems  in 
motivating  a  Soviet  presence  in  the  region.  Jukes  (SNP:  315-16)  raises 
the  connection  between  the  Soviets'  SS-9  and  SS-18  heavy  intercontinental 
ballistic  missiles,  which  can  attack  the  United  States  by  flying  the 
"long-way,"  i.e.,  around  the  South  Pole.  Accuracy  along  this  trajectory 
would  require  some  form  of  mid-course  guidance.  This  might  be  supplied 
from  a  well-su>*veyed  ground  station  in  the  Indian  Ocean  area.  MccGwire 
(SND:  427,  436)  notes  that  the  polar  orbit  from  the  Soviets'  space  center 
passes  over  the  Indian  Ocean  and  Soviet  space  support  jhips  have  been 
frequent  visitors  to  the  region. 

The  primary  factor  behind  the  Soviet  presence  in  their  views, 
however,  is  the  threat  of  Polaris  operations.  MccGwire  (SND ;  441) 
writes: 

All  the  available  evidence  .  .  .  points  to  the  high  priority 
accorded  by  the  Soviet  Union  to  the  threat  from  U.S. 
ballistic-missile  submarines  and  measures  toward  countering 
,  it  ...  it  is  hard  to  escape  the  conclusion  that  the  very 

clear  indication  that  the  United  States  was  developing  the 
capability  to  operate  ballistic-missile,  submarines  in  the 
Indian  Ocean,  must  have  been  a  major  (and  perhaps  the 
determining  factor)  in  deciding  the  Soviet  Union  that  she, 
in  turn,  must  embark  on  the  costly  process  ...  of 
developing  the  capability  to  operate  in  the  area. 

Jukes  writes  (SNP:  315)  that  the  two  Soviet  purposes  in  the  region  are 
"area  familiarization  with  the  Arabian  Sea  against  a  postulated  future 
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Polaris/Poseidon  deployment,"  and  maintaining  a  position  to  continue 
influence  on  Arab  and  Middle  East  developments.  With  respect  to  the 
latter  he  writes  (p.  316): 

But  from  "protection  of  state  interests  in  time  of  peace"  as 
a  by-product  of  a  combat  role  to  installation  of  forces 
primarily  in  the  interest  of  such  a  peacetime  function  is  a 
long  step  .  .  .  this  step  has  not  been  taken  yet  in  general 
terms,  and  the  Indian  Ocean  deployment  presents  no  evidence 
with  which  to  contradict  this  interpretation. 

Smolansky  (SND:  421)  views  Russian  entry  as  motivated  by  several 
factors,  but  primarily  by 

Western  actions  (specifically  the  introduction  of  the 
Polaris/Poseidon  fleet  into  the  Indian  Ocean)  have  been  a 
major  consideration  impelling  the  establishment  of  a  Soviet 
naval  presence  in  the  area.  Thus,  far  from  the  aggressive 
intent  so  frequently  ascribed  to  these  recent  Russian  moves, 
Moscow's  main  concern  seems  to  have  been  military  defense. 

Smolansky  sees  the  Soviets  as  having  no  vital  interests  in  the  region  with 
te  exception  of  the  strategic  defensive  mission  of  preventing  SLBM  strikes 
from  the  Arabian  Sea.  While  Soviet  interests  are  important,  they  are  not 
vital  to  the  USSR's  security. 

Nevertheless,  Smolansky  predicts  the  Soviets  will  continue  to 
conduct  a  contest  for  influence  in  the  region  while  attempting  to 
neutralize  the  U.S.  ocean-borne  strategic  threat.  This  contest  is  likely 
to  accelerate  and  intensify,  he  predicts  (p.  422).  Smolansky  (SNP ,  ch. 
14)  does  not  foresee  any  significant  Soviet  influence  developing  in  the 
Persian  Gulf,  nor  does  he  view  domination  of  the  Gulf  as  a  Soviet  goal. 
Nor  is  interference  with  the  shipments  of  Persian  Gulf  oil  to  the  West  a 
likely  Soviet  move  in  the  future,  since  any  interference  would  prompt  a 
confrontation  with  the  United  States,  something  the  Soviets  have 
consistently  avoided.  Moscow  will  pursue  "low  risk"  opportunities  but  the 
Soviets'  general  lack  of  influence  and  inability  to  control  events  will 
yield  only  marginal  chances  for  improving  their  diplomatic  and  political 
presence. 

In  contrast  to  Jukes,  MccGwire,  and  Smolansky,  several  naval 
analyses  disagree  that  the  Soviets'  foremost  purpose  in  the  Indian  Ocean 
is  strategic  defense.  McConnell  (SNDt  390)  explicitly  disputes  the 
Polaris  threat  as  a  major  motivation  for  the  Soviet  Indian  Ocean  presence. 
He  notes  that  the  United  States  has  never  announced  a  Polaris  deployment 
to  the  Arbian  Sea  or  the  Indian  Ocean,  The  submarine  tenders  that 
typically  support  U.S.  ballistic  missile  submarines  have  not  appeared  in 
the  Indian  Ocean,  McConnell  also  claims  there  is  no  need  for  a  U.S. 
deployment  of  SLBMs  to  this  area  since  the  targets  are  otherwisa  in  range, 
and  the  transit  time  to  the  Arabian  Sea  would  be  inefficient  and  atypical 
in  comparison  to  known  deployments  from  the  U.S.  submarine  bases  at  Guam 
in  the  Pacific,  Holy  Lock  in  the  North  Sea,  and  Rota  in  the  Mediterranean. 
McConnell  notes  the  lack  of  any  computable  facility  to  service  U.S. 
deployments  in  the  Indian  Ocean,  He  argues  (p.  391)  that  a  U.S.  ’olaris 
deployment  would  be  counterproductive  since 
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There  is  probably  no  easier  way  to  get  Russian  ships 
steaming  all  over  the  Indian  Ocean  than  to  introduce  a 
strategic  threat. 

Nevertheless,  Soviet  ships  are  "steaming  all  over  the  Indian 
Ocean,"  especially  in  the  northwest  quadrant  that  would  serve  best  as  an 
SLBM  launching  point.  McConnell  says  nothing  about  the  U.S.  naval 
communications  station  that  was  constructed  on  Australia's  Northwestern 
Cape  in  the  1960s  and  70s,  the  communications  facility  that  was  formerly 
maintained  at  Asmara,  Ethiopia,  or  the  U.S. -British  naval  facility 
developed  at  Diego  Garcia,  at  the  southern  margins  of  the  Arabian  Sea. 
MccGwire  (SND)  argues  that  the  capability  provided  by  these  facilities  to 
support  U.S.  Polaris  operations  are  sufficient  to  produce  a  Soviet 
defensive  reaction,  even  if  the  Polaris  submarines  themselves  do  not 
practice  deployment.  McConnell  acknowledges  that  this  threat  may  be  taken 
serious  by  the  Soviets  and  he  quotes  a  Pravda  reporter  as  saying  the 
Americans  intend  to  expand  Polaris  combat  patrols  to  the  northern  Indian 
Ocean.  _ 

McConnell  concurs  (p.  391)  with  Smolansky  that  a  Soviet  blockade 
of  Persian  Gulf  oil  is  "scarcely  credible"  since  it  would  harm  the  Arabs, 
whose  favor  the  Soviets  court,  but  more  importantly,  it  would  lead  to  war 
with  NATO.  Nor  does  McConnell  see  Russian  planners  as  much  concerned  with 
protection  of  sea  lines  of  communication  through  the  Indian  Ocean,  since 
their  main  concern  is  general  nuclear  war,  and  such  logistics  would  be 
unimportant.  Consequently,  McConnell  writes  (p.  391),  "the  evidence  more 
and  more  suggests  peacetime  rather  than  wartime  missions  for  the  Soviet 
Indian  Ocean  detachment*"  The  peacetime  protection  of  state  interests,  of 
which  Admiral  Gorshkov  writes,  includes,  in  the  Indian  Ocean,  protection 
of  Russian  shipping,  fishing,  and  scientific  activities; 
influence-peddling  through  goodwill  visits;  and  protection  of  client 
states. 

In  the  last  role,  McConnell  sees  Soviet  ships  as  providing  a 
deterent  to  Western  intervention  and  a  maintenance  of  the  status  quo, 
rather  than  commitment  to  violent  offensive  action  or  confrontations.  He 
does  not  view  (p.  400)  the  Soviet  Navy  as  likely  to  contest  issues  which 
were  important  to  Western  interests.  McConnell  suggests  the  Soviets' 
long-range  objective  in  the  region  is  the  negotiated  mutual  withdrawal  of 
U.S.  and  Soviet  navies: 

Basic  to  Soviet  reasoning  would  be  the  calculation  that 
there  is  more  to  be  gained  by  the  removal  of  a  Western  naval 
presence  than  the  maintenance  of  a  competing  Soviet 
.  presence. 

Calhoun  and  Petersen's  (NPSP,  ch.13)  analysis  of  Soviet  views  on 
naval  arms  limitation  reiterates  the  strong  Soviet  concern  over  U.S. 
ballistic  missile  submarine  deployment  In  the  Indian  Ocean  and  the  Diego 
Garcia  base.  However,  they  note  changes  in  Soviet  naval  operations  in  the 
Indian  Ocean  that  are  not  merely  defensive  and  which  suggest  the  Soviet 
Navy  may  seek  a  limitation  only  on  strategic  naval  capabilities  in  the 
Indian  Ocean,  leaving  the  Soviet  general  purpose  ships  free  to  conduct 
naval  diplomacy.  Namely,  Soviet  naval  forces  were  involved  In  four  cases 
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of  naval  diplomatic  initiative  between  1973  and  1975:  mine  sweeping  in 
Bangladesh,  supporting  Iraq's  attack  on  Kuwait,  patrolling  the  Strait  of 
Hormuz,  and  development  C  naval  facilities  at  Berbers,  Somalia,  and  Aden, 
in  South  Yemen,  astride  the  Bab  el  Mandeb  straits  to  the  Suez  Canal. 
Calhoun  and  Petersen  sec  (p.  242)  these  as  instances  of  "direct 
intervention  to  shift  the  balance  (rather  than  to  maintain  the  status 
quo)  militarily  and  politically  in  favor  of  the  preferred  aide  and  —  more 
significantly  —  away  from  the  West  (and  China)."  Calhoun  and  Petersen 
view  (p.  240)  these  changos  as  revealing  "something  about  Soviet 
intentions:"  (a)  a  capability  and  willingness  to  match  the  Increased 
force  levels  deployed  to  the  region,  and  (b)  a  heavier  commitment  of 
Soviet  military  power  to  nations  in  the  region. 

Graham  (NPSP :  287)  also  seems  to  see  no  Soviet  interest  in 
withdrawal  from  the  Indian  Ocean: 

What  Moscow  pursues  is  the  chance  to  exploit  any  weakness, 
any  possibility  that  offers  itself  a  chance  to  increase  its 
influence,  to  bring  adversaries  into  disarray,  and  to  create 
a  clientele  among  the  Indian  Ocean  regional  states. 

Graham  categorizes  these  as  political,  economic,  and  military  efforts 
aimed  at  an  "outflanking  strategy"  and  a  "chokepoint  strategy."  With 
respect  to  the  first,  Graham  writes  (p.  281-2)  “the  Soviets  perceive  a 
need  .  .  .  tor  naval  capabilities  in  order  to  outflank  from  the  sea  both 
China  and  NATO  .  .  ..  The  prospect  of  being  able  to  deny  (Persian  Gulf] 
oil  to  the  West  may  be  major  impetus  to  Soviet  global  strategy."  The 
Soviet  naval  forces  in  the  Indian  Ocean  are  seen  as  achieving  these  ends 
as  well  as  protecting  Russia's  sea  lines  from  the  Black  Sea  to  the  Soviet 
Far  East.  Graham  does  not  note  that  Soviet  forces  are  insufficient  for 
any  of  these  missions  in  either  war  or  peace. 

Graham  describes  (p.  282)  the  "chokepoint  strategy:" 

Soviet  strategy  in  the  Indian  Ocean  Is  to  establish  a  naval 
presence  .  .  .  through  which  Moscow  can  influence  the 
policies  of  the  Indian  Ocean  littoral  states  as  well  as 
control  the  approaches  •  .  .  should  the  need  arise,  such  as 
in  wartime. 

This  strategy  is  aimed  at  depriving  the  West  of  strategic  materials  and 
oil.  Again,  the  Soviet  Navy,  lacking  any  air  capability  afloat,  could  not 
execute  this  strategy,  a  major  weakness  in  Graham's  thesis*  Furthetmoro, 
the  Soviets  have  experienced  repeated  setbacks  from  Indian  Ocean  littoral 
states  (e.g.,  Somalia,  Indonesia).  Nonetheless,  Graham  seos  (p,  298)  the 
Soviets  as  persisting  in  the  pursuit  of  influence  and  facilities  to 
achieve  these  strategic  and  political  missions. 

Graham  seems  to  see  fewer  problems  in  store  for  the  Soviets  in 
seeking  these  objectives  than  actually  exist.  The  Soviet  Navy's  inability 
to  close  off  chokepoints  or  outflank  both  NATO  and  China  has  already  been 
noted.  Graham  seas  Ethiopia  as  ample  compensation  for  the  Soviet  naval 
facilities  lost  in  Somalia.  This  overlooks  the  Eritrean  rebels,  who  are 
fighting  the  Soviet-backed  Mongistu-regime,  control  much  of  the  coastline, 
and  have  prevented  any  extensive  Soviet  development  of  bases  to  replace 
those  lost  in  Somalia  at  Barbara  and  Mogadiscio. 
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The  Atlantic  Council  review  of  Soviet  naval  developments,  Securing 
the  Seas,  also  asserts  some  of  Graham's  hypotheses.  The  Soviet  quest  tor 
warm  water  ports  is  seen  (p.  441)  as  a  possible  Soviet  objective  in  the 
Indian  Ocean.  Soviet  blockades  during  another  Arab-Israeli  war  or  Soviet 
support  for  an  Arab  blockade  of  the  Strait  of  Hormuz  are  suggested  (p. 
419)  as  “plausible  scenarios”  of  Soviet  interpositioning  and  resistance  to 
U.S.  involvement  in  the  area.  However,  the  STS  review  does  not  see  (p. 
440)  direct  Soviet  harrassment  or  interruption  of  Western  maritime  trade 
as  likely,  even  though  Soviet  naval  and  political  capabilities  for  such 
interference  have  increased,  because  the  Soviets'  own  maritime  units  are 
as  vulnerable  (or  more  so)  to  interception.  The  Soviets  are  more  likely 
to  attempt  to  stem  the  flow  of  resources  or  trade  at  the  scurce,  through 
strikes,  embargoes,  sanctions  and  other  means  that  do  not  put  the  Soviet 
merchant  fleet  in  jeopardy. 


Case  9;  Future  Soviet  Objectives  for  Forward  Deployment 

Regardless  of  differences  among  analysts  over  the  causes  of  Soviet 
naval  forward  deployment,  the  level  of  out-of-area  naval  activity  has 
remained  high.  An  important  analytic  issue  is  the  future  use  of  this 
naval  force.  What  are  Hoscow's  intentions  governing  the  future  use  of 
forward  deployed  naval  forces? 

Booth  (1977)  notes  the  differences  of  emphasis  between  two  groups 
of  analysts  on  this  question.  One  viewpoint  emphasizes  the  possibility 
that  the  Soviet  Navy  will  continue  to  be  and  may  increasingly  act  as  an 
instrument  of  general  Soviet  foreign  policy.  This  group  of  analysts  (the 
“political  school”  will  serve  as  an  inaccurate  but  short  appellation)  sees 
the  Soviet  Navy  as  becoming  more  active,  aggressive,  and  expansive  in 
peacetime  missions.  At  the  extreme  Soviet  Navy  interventions  against 
Western  clients  and  Soviet  deterrence  of  Western  intervention  in  crises 
are  seen  as  possible  uses  of  growing  capabilities  for  power  projection. 
In  effect,  the  possible  use  of  Soviet  naval  power  and  other  capabilities 
of  force  projection  to  upset  the  status  quo  and  the  superpower  balance  in 
the  Third  World  are  no  longer  viewed  as  too  risky  for  the  Soviets. 

On  the  other  hand,  a  second  group  of  analysts  (the  “military 
school”)  views  the  forward  deployed  Soviet  Navy  as  primarily  still 
concerned  with  wartime  naval  missions,  with  only  a  secondary  emphasis  on 
enhancing  diplomatic  influence  or  prestige.  This  group  views  the  Soviets 
as  still  not  having  solved  its  problems  in  achieving  general  war  missions. 
While  political  gains  can  be  secured  as  by-products  of  continued  naval 
effort®  to  solve  the  war  mission  problems,  "the  surplus  for  projecting 
power  by  military  force  has  been,”  Booth  writes  (p*  58),  “at  most,  small." 
Thus,  while  the  Soviets  will  exploit  opportunities  to  upset  or  challenge 
the  status  quo,  they  cannot  afford  to  risk  much  to  do  so. 

Booth  (1977s  49)  observes  that  both  groups  agree  that  the  Soviet 
Navy  requires  maritime  stability  to  fulfill  its  foreign  policy  tasks, 
whether  narrow  or  expansive.  A  direct  clash  with  the  West  would  remove 
the  freedom  of  the  seas  and  risk  escalation  to  goner  ’  war,  which  would 
eliminate  much  or  all  of  the  Soviet's  capability  to  project  diplomatic 
power  or  influence.  Booth  writes  (p.  49)  that  “for  these  reasons  the 
Soviet  Union  is  unlikely  to  engage  in  limited  hostilities  at  sea  beyond 
occasional  maritime  truculence." 

The  authors  of  the  Atlantic  Council  Working  Group  (Nitxe, 
Sullivan,  et  al.,  STS:  418)  seem  to  question  Booth's  assumption: 
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Because  of  the  increasing  strength  of  their  conventional 

deep  sea  forces  and  thu  relative  decline  of  Western  naval 

strength,  the  Soviets  may  elect  to  resist  U.S.  involvement 

in  some  “local  war." 

They  also  view  the  Soviets  as  having  "plainly  demonstrated  their 
intentions"  to  supply  client  states  with  arms  and  proxy  forces  in  local 
wars.  This  intention  to  become  involved  in  local  conflicts  could  touch 
off  a  direct  U.S. -USSR  confrontation  in  their  views,  and  two  "plausible 
scenarios"  are  suggested.  During  another  Arab-Israeli  war  the  Soviets 
might  attempt  a  blockade  of  Israel.  Alternatively,  if  a  Mideastern  nation 
attempted  to  block  the  Strait  of  Hormuz,  the  Soviets  might  resist  U.S. 
attempts  to  thwart  the  blockade. 

The  Atlantic  Council  Working  Group  also  viewed  (p.421)  the  Soviet 
Navy  as  increasingly  likely  to  attempt  to  inhibit  "the  free  movement  and 
deployment  of  Western  naval  forces"  during  Third  World  crises.  This 
effort  in  the  past  has  been  "a  clearly  inhibitory  impact"  on  the  West, 
and,  they  imply,  this  impact  will  probably  become  greater.  Inasmuch  as 
they  view  (p.  423)  other  elements  of  Soviet  diplomatic  projection  (e.g., 
the  Merchant  Marine)  extending  into  traditionally  Western  areas  and 
regions,  the  geographical  realm  for  U.S. -Soviet  naval  confrontation  may 
also  increase.  An  important  element  of  Soviet  maritime  expansion  is 
access  to  defensible,  warm-water  ports  for  naval  forces.  The  working 
group  views  (p.  410)  the  Soviets  as  likely  to  attempt  to  gain  such  access 
politically,  especially  in  the  Indian  Ocean,  but  by  this  they  imply  a 
major  role  for  the  Soviet  Navy  in  t!  effort. 

Graham  (NPSP ,  ch .  16)  also  seems  to  view  the  Soviets  as 
increasingly  willing  to  risk  confrontations  with  the  U.S.  Navy  in  the 
forward  area.  He  writes  of  an  evolving  Soviet  strategy  in  the  Indian 
Ocean  of  chokepoints,  and  implies  (p,  290)  a  Soviet  willingness  to 
interfere  with  Western  oil  supplies  and  sea  passage  in  conventional  war. 
He  writes  (p.  289)  that  the  Soviets  “recognize  that  some  capability  to 
interdict  Western  oil  supplies  gives  (the  Soviets]  great  political 
leverage,  even  if  they  never  exercise  that  capability  in  an  operational 
sense."  This  clearly  implies  a  Soviet  effort  to  win  such  control  in 
peacetime  as  well.  The  Soviets'  goal  (p.  288)  in  the  Indian  Ocean  is  "to 
become  the  dominant  external  power,"  and  their  major  objective  (p,  275)  is 
to  secure  warm  water  ports. 

Some  members  of  the  “political  school"  of  analysts  see  the 
acquisition  of  overseas  bases  as  a  major  objective  of  Soviet  naval 
diplomacy  (e.g.,  Blechman  and  Levinson,  SNI,  ch.  22;  Kelly,  SNI,  ch.  26), 
but  so  do  some  spokesmen  of  the  "military^schcol"  (e.g.,  Booth,  1977?  62; 
KccGwiro,  SNI;  634),  The  two  groups  differ  in  what  they  consider  the 
motivation  for  those  efforts.  Kelly  (p.  513)  views  Soviet  Navy  uso  of 
Third  World  facilities  as  increasingly  for  "practical,  direct  support  for 
specific  foreign  policy  initiatives  and  campaigns,"  e.g.,  support  of  local 
wars.  The  military  school  stresses  the  economic  and  strategic  advantages 
which  bases  in  the  forward  area  give  the  Soviet  Navy  (e.g.,  MccGwire,  SND, 
chs.  18,  2  5)  and  raises  the  question  of  whethur  those  bases  the  Soviets 
acquired  in  the  past,  e.g.,  Egypt,  at  great  expense  yielded  sufficient 
political  gains  (MccGwire,  SNI :  634-37)  to  tempt  the  Soviets  to  quickly 
repeat  the  experience.  The  strategic  military  need  for  bases  is  another 
matter,  one  which  may  justify  heavy  costs  and  may  require  diplomacy  In  aid 
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of  military  purposes  (Booth,  1977$  62).  Kelly  also  sees  (p.  520  ff)  the 
Soviets  as  seeking  submarine  bases  for  strategic  deterrent  purposes  and 
possible  conventional  purposes,  i.e.,  near  sea  lane  chokepoints. 
Nevertheless,  she  gives  equal  emphasis  to  the  Soviet  Navy's  diplomatic  and 
political  missions  that  these  bases  facilitate.  Blechman  and  Levinson  see 
(p.  426,  439)  the  efforts  to  establish  a  submarine  base  in  Cuba  as  "m 
almost  textbook  case  of  Soviet  political-military  tactics**  and  suggest 
that  major  goal  in  this  effort  is  to  challenge  U.S.  security  politically, 
by  showing  U.S.  resolve  and  credibility  are  weak.  They  argue  that  the 
Soviets  seek  the  base  primarily  as  a  symbolic  demonstration  of  an  American 
lack  of  will.  In  contrast,  MccGwire  (SND,  ch.  33)  outlines  several  naval 
tasks  that  Soviet  submarines  could  perform  more  efficiently  and 
effectively  from  Cuba,  e.g.,  against  U.S.  carriers  and  Polar is/Poseldon 
submarines. 

Dismukes  and  McConnell  (1979)  offer  the  roost  extensive  analysis  of 
the  use  of  the  Soviet  Navy  for  diplomatic  and  political  objectives.  They 
write  (p.  295)  "political  considerations  have  dominated  Soviet  motivations 
for  operating  their  genera  1-pupose  navy  in  the  forward  area.*4  A  variety 
of  "magnets**  in  the  Third  World  will  continue  to  attract  superpower  naval 
involvement  and  yield  returns  to  coercive  naval  diplomacy;  "there  is  not 
the  slightest  sign  of  official  [Soviet]  disenchantment,"  they  write  (p, 
303)  "with  naval  diplomacy-" 

Dismukes  and  McConnell  believe  that  a  defensive,  status  quo 
principle  governs  the  use  of  the  Soviet  Navy  for  political  and  diplomatic 
purposes  and  will  tend  to  do  so  for  the  future  (p.  245-46).  Most  Soviet 
objectives  will  be  obtained  without  violence,  through  naval  presence  or 
the  augmentation  of  area  forces  as  needed  (pp.  284,  287),  Their  crisis 
behavior  will  be  cautious  and  restrained  and  Moscow  may  vary  the  risks  by 
its  encouragement  to  clients,  hut  will  be  reluctant  to  increase  risks 
itself.  However,  Dismukes  and  McConnell  note  (p,  308)  that 

...  in  general,  should  the  sovereignty  of  a  client  be 
jeopardized,  (they]  would  expect  the  Soviet 
politico-military  instrument  to  be  made  available  ,  .  , 
Nothing  else  would  maintain  Moscow's  credibility  as  a 
patron. 

Seemingly,  the  scenarios  outlined  by  the  Atlantic  Council  working  group 
would  seem  leas  plausible  to  Dismukes  and  McConnell. 

In  contrast  to  the  favorable  outlook  for  the  continuation  and 
expansion  of  Soviet  naval  diplomacy  which  Dismukes  and  McConnell  (1979) 
perceive,  other  analysts  place  greater  weight  on  the  limitations  the 
Soviets  face  in  this  cause.  MccGwire  (1979a)  questions  Soviet  political 
commitment  and  naval  capabilities  for  this  course,  Friedman  (NPSt\  eh,  11) 
notea  the  limitations  imposed  by  the  Soviets'  “sea  denial"  philosophy, 
Ginsbergs  (SNI,  ch,  23)  observes  the  limits  imposed  by  Soviet  influence 
mechanisms,  and  Herzog  (NFS?,  ch.  5)  describes  the  impact  of  the  strategic 
mission. 

MccGwire  (1979a;  177-182)  views  Soviet  commitment  to  peacetime 
naval  operations  as  a  continuum  ranging  from  "protecting  Soviet  lives  and 
property"  at  the  low  end  of  commitment,  to  "establishing  a  strategic 
infrastructure  to  support  war-related  missions"  at  the  high  end.  MccGwire 
views  this  latter  as  the  primary  motive  for  Soviet  naval  involvement  in 


52 


♦  ■»» 
| 


3 

4* 


Third  World  diplomacy*  Because  this  mission  touches  directly  on  the 
security  of  the  Soviet  homeland,  analysts  of  the  "military  school"  view  it 
as  the  foremost  motive  for  the  Soviet  Navy's  peacetime  actions  (cf.  Booth, 
1977;  MccGwlre,  1979a:  179),  Naval  involvement  in  aid  of  this  goal  serves 
other  political  and  diplomatic  functions. 

In  between  these  extremes  HccGwire  (1979a)  views  "increasing 
Soviet  prestige  and  influence"  and  "countering  imperialist  aggression"  as 
objectives  for  which  Soviet  political  commitment  in  low.  Ho  perceives  (p. 
179-80),  for  example,  no  evidence  of  "Soviet  readiness  to  actually  engage 
Uestern  naval  forces,  in  order  to  prevent  them  from  intervening  against  a 
Soviet  client  state."  HccGwire  does  see  a  greater  Soviet  willingness  to 
supply  and  support  clients  during  third  party  conflicts  and  a  policy  of 
incrementalism  and  opportunism;  probing  Western  responses  and  creating 
precedents.  HccGwire  sees  the  Soviet  Navy's  long-term  interests  as  only 
partly  served  by  the  foreign  policy  of  increasing  influence  in  the  Third 
World,  and  conversely,  Soviet  foreign  policy  is  sometimes  ill-served  by 
the  foreign  entanglements  and  commitments  required  by  naval  security 
concerns  and  the  requirements  for  a  distant  strategic  infrastructure 
These  conflicts  of  interst  are  likely  to  continue  and  remain  limits  on 
Soviet  peacetime  naval  diplomacy  in  the  forward  area. 

Herzog  (NPSP,  ch.  3)  describes  how  the  Soviet  Navy's  strategic 
peacetime  deterrent  forces  have  begun  to  retreat  Into  ballistic  missile 
submarine  (SSBNs)  sanctuaries  near  Soviet  coasts.  To  control  these  areas 
and  protect  these  peacetime  strategic  deterrent  and  wartime  strategic 
reserve  nuclear  forces,  the  Soviet  surface  fleet  is  being  reconfigured  for 
ASW  purposes,  to  operate  under  the  land-based  air  cover  of  the  SNA,  These 
newest  sot  face  ships,  however,  are  also  those  most  capable  of  operating  in 
distant  waters  and  exercising  peacetime  influence  missions  in  the  Third 
World.  In  effect,  the  peacetime  mission  of  SSBN  sanctuary  protection 
conflicts  with  the  naval  influence  mission.  If  newer  ships  are  risked  in 
Third  World  area  crises,  they  cannot  >fend  SSBNs*  near  Soviet  coasts.  In 
fact,  as  crises  develop,  the  Soviets  see®  to  remove  these  newer  ASW  units 
from  the  danger  area.  This  means  the  newer  Soviet  surface  ships  might 
only  be  commited  to  lew  risk  diplomatic  missions,  Herzog  writes  <p»  5$) 


As  long  as  the  Western  fleets  are  built  around  the  GV 
the  attack  aircraft  carrier),  there  is  m  way  the  Soviet 
surface  units,  Kiev  included,  could  assume  an  offensive 
rote. 

tinder  the  defensive  umbrella  of  the  SSBS  sanctuaries  these  units  can 
perform  their  “strictly  strategic  defensive  role,**  but  this  limits  their 
capability  and  constrains  Soviet  Intentions  to  risk  them  in  Third  World 
naval  diplomacy. 

Friedman  (N£§£,  ch*  U)  points  to  the  inconsistencies  between  the 
Soviets”  sea  denial  philosophy  and  Soviet  need  for  sea  control  forces, 
which  the  Soviets  Have  never  shown  any  interst  in  building,  and  have  spent 
ouch  effort  attempting  to  circumvents.  Sea  control  demands  greater 
capability  for  flexibility  and  sustained  operation  than  the  Soviets  have 
yet  designed  into  their  ships  or  supply  facilities.  Either  the  Soviets 
oust  suffer  limited  endurance  from  their  units,  or  improve  afloat 
replenishment  and  repair  capabilities,  or  seek  a  network  of  foreign  bases 
and  facilities.  Foreign  bases,  however*  impose  sea  control  requirements. 
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Replenishment  and  repair  ships  require  fleet  concentrations  which  are 
inconsistent  with  sea  denial  dispersal  tactics.  Greater  individual  unit 
endurance  implies  greater  costs,  nuclear  propulsion,  and  violates  the 
economic  and  technical  bases  of  the  sea  denial  philosophy.  These 
inconsistencies  pose  serious  limits  on  Soviet  efforts  to  project  power  in 
peacetime  with  naval  forces  designed  for  sea  denial. 

Ginbergs  (SNl,  ch.  23)  observes  that  the  political  instruments 
available  to  the^Soviets  for  advancing  Third  World  diplomacy  offer  few 
assurances  of  success.  Although  the  Soviets  may  labor  long  and  hard  for 
influence,  presence,  and  bases  in  the  Third  World,  all  these  can  be  lost 
quickly  and  suddenly,  leaving  the  Soviets  no  alternative  but  to  start  over 
elsewhere.  In  effect,  Moscow  cannot  count  on  allies  in  the  Third  World. 
Consequently,  Ginbergs  sees  (p,  446)  the  Soviets  as  following  a  "narrow 
agenda  of  bases  to  acquire"  in  a  "few  choice  locations,"  and  tending  to 
"gravitate  toward  low-risk  projects."  However,  Soviet  successes  will  be 
confined  to  a  few  Third  World  states  with  a  peculiar  constellation  of 
features:  those  with  home-grown  socialism,  that  have  fallen  out  with  the 
West,  that  are  in  or  face  military  conflicts,  or  which  require  Soviet 
protection  to  avoid  military  defeat.  These  factors  can  offer  the  Soviets 
worthwhile  opportunities,  but  they  considerably  narrow  the  choices  on  the 
menu. 
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CHAPTER  4.  EVALUATION  METHODS  AND  APPRAISALS 


This  chapter  is  divided  into  two  main  sections,  Estimation  Logic, 
and  Narrative  Logic,  The  first  section  treats  intention  estimation  as  a 
judgment  process.  It  decomposes  intention  estimation  into  seven  main 
tasks  and  examines  in  detail  the  analytic  processes  within  each  task,  A 
variety  of  cognitive  biases  are  noted  that  tend  to  distort  or  weaken 
analytic  accuracy.  Examples,  taken  from  our  sample  of  naval  estimates, 
are  used  to  show  how  these  cognitive  biases  actually  occur  in  the  work  of 
naval  analysts. 

The  second  main  section.  Narrative  Logic,  views  intention 
estimation  as  a  form  of  historical  narrative  rather  than  as  a  problem  of 
judgment  or  decision.  This  section  divides  historical  narration  into 
inquiry  and  explanation,  and  examinus  the  problem  of  fallacious  historical 
reasoning  in  these  two  areas.  Many  of  the  historical  fallacies  reviewed 
in  this  section  are  directly  related  to  the  cognitive  bioses  described  in 
the  section  on  Estimation  Logic. 

ESTIMATION  LOGIC 

There  is  no  such  thing  as  a  classification  of  the  ways  in 
which  men  may  arrive  at  an  error:  it  is  much  to  be  doubted 
whether  there  ever  can  be. 

Augustus  de  Morgan,  184? 

In  appraising  estimates  of  Soviet  naval  intentions  one  can 
examine  an  analyst's  argument,  compare  the  analyst's  logic  to  the  data  and 
to  other  analysts'  arguments,  and  evaluate  the  arguments'  logical 
structure,  i.e,,  how  analysts  connected  together  hypotheses,  data, 
conclusions  and  theories.  In  this  sect,  ion  the  logical  process  of 
estimation  is  broken  into  parts  and  ^he  weaknesses  of  these  parts  are 
assessed.  Throughout  this  section  an  effort  is  made  to  use  exam, from 
our  sample  of  naval  estimates.  These  are  used  to  suggest  a  possible 
weakness  and  to  illustrate  how  it  may  occur  in  naval  estimation*,  our  goal 
is  not  to  prove  that  the  particular  analyst's  argument  is  logically  weak 
—it  may  or  may  not  be. 

lie  break  down  estimation  logic  into  seven  processes: 

o  perceiving  data 
o  weighing  data 
o  characterising  data 
o  assessing  covariations 
o  assessing  causes  and  effects 
o  prediction 

o  forming,  maintaining  and  changing  theories 

Not  every  estimate  explicitly  includes  each  process,  e.g.,  some 
estimates  studiously  avoid  making  any  predictions.  We  would  argue, 
however,  that  so ms  form  of  each  of  these  processes  is  involved  implicitly 
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in  every  estimate.  This  conclusion  is  based  on  the  plausible  notion  that 
all  Judgmental  thinking  and  reasoning  (not  just  naval  estimation)  entails 
these  processes.  A  recent  explication  of  this  general  notion  about 
thinking,  Nisbett  and  Rosa's  Human  Inference;  Strategies  and  Shortcomings 
of  Social  Judgment  (1980),  provided  this  seven-part  taxonomy  and  reviewed 
literature  that  relates  these  processes  to  all  forms  of  inference. 

This  seven-part  breakdown  is  noe  immutable,  other  analyses  of 
reasoning  use  more  or  less  than  seven  categories  to  break  down  the 
thinking  and  judgment  processes.  For  example,  Einhorn  and  Hogarth  (1981) 
use  four:  information  acquisition,  evaluation,  action,  feedback  and 
learning.  Because  their  taxonomy  was  derived  specifically  for 
decision-making,  rather  than  inference  and  judgment  in  general,  it  differs 
from  Nisbett  and  Ross's  seven-part  process  in  collapsing  several  of  the 
latter's  categories  (i.e.,  perceiving,  weighing  and  categorizing  data 
generally  equate  to  information  acquisition  and,  in  part,  evaluation),  and 
in  putting  more  stress  on  action  and  learning  (which  in  the  Nisbett/Ross 
scheme  are  part  of  the  prediction  and  theory  processes). 

In  this  section  each  of  the  seven  processes  is  described  in 
general  and  in  terms  of  naval  analysis.  The  biases  and  weaknesses  which 
influence  that  process  are  described  and  related  to  instances  selected 
from  our  sample  of  naval  estimates.  If  examples  could  not  be  found  in  the 
naval  estimates  sampled,  a  hypothetical  naval  example  is  described.  (The 
failure  to  find  a  “real"  instance  of  a  particular  bias  in  no  way  means 
that  that  bias  is  absent  in  naval  estimation  —  only  that  it  may  be  rare 
in  our  sample,  or  overlooked  by  me.) 

Before  beginning  the  description  of  the  parts  of  estimation  logic 
it  is  helpful  to  relate  these  processes  to  Scheibe's  (1979) 
trichotomiration  of  prediction.  Recall  that  Scheibe  attributed  prediction 
to  sagacity,  control  and  authority,  and  acumen.  Sagacity,  or  the  ability 
to  organize  perceptions  of  past  behavior  and  abstract  from  these  a  set  of 
predictive  indicators,  is  related  to  the  seven-part  estimation  process 
examined  in  this  section.  In  contrast,  Scheibe's  acumen  is  insight  or 
empathy  into  the  actions  or  reactions  of  another  rather  than  analysis  or 
judgment.  Acumen  can,  however,  be  thought  of  as  an  estimation  ability, 
most  commonly  found  as  narration,  or  explanation.  That  is,  many  estimates 
are  basically  coherent  narrative  explanations  of  events  which  attempt  to 
organize  the  salient  facts  into  a  uholiatic,  meaningful  story  (Pipes, 
1980;  Satbin,  1980)-  In  a  later  section  estimation-as-narration  is 
examined.  In  the  present  section  the  estimation  process  is  viewed  as  one 
of  logic,  judgment,  and  decision-making. 

Perceiving  Data 

One  of  the  oldest  and  most  reliable  generalisations  in  psychology 
1*  that  perception  is  nos  merely  the  passive  receipt  of  information  but  is 
instead  a  process  of  active  interpretation,  selective  attention, 
deduction,  and  inference.  The  “facts*  never  “speak  for  themselves*  in 
forming  perceptions  and  perceptions  are  always  influenced  by  “knowledge 
structures,*  or  general  information  processing  schemes,  that  people  use  to 
organise  the  stream  of  data  they  perceive.  Two  of  the  better-known 
knowledge  structures  whim  affect  the  perception  of  data  have  been  labeled 
the  “availability*  and  "representativeness"  heuristics  (or  judgment 
strategies;  Kahneman  and  Tvcrsky,  1972,  1973;  Tversky  and  Kahne&an,  1971, 
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1973,  1974). 

The  set  heuristics  are  staple,  generally  automatic,  strategies 
people  use  In  a  variety  of  inferential  anti  judgment  tasks,  including  data 
perception.  These  strategies  arc  often  efficient  and  effective  In 
organizing  data  into  useful  perceptions.  Because  they  are  often  applied 
automatically  (that  is,  without  conscious  deliberation)  they  may  he 
misapplied  or  misused  In  eases  .here  more  appropriate  heuristics  would 
yield  more  accurate  perceptions.  The  representativeness  and  availability 
heuristics  are  not  always  involved  in  perception,  and  in  cases  where  chair 
application  might  generate  errors,  people  sometimes  avoid  using  them.  In 
other  cases,  however,  they  do  not,  and  the  heuristics  load  to  erroneous 
data  perception. 

The  Availability  Heuristic 

In  general,  the  more  often  and  the  mere  frequently  events  are 
perceived,  the  more  easily  they  ate  encoded  and  remembered  and  the  more 
likely  it  is  that  the  pereeiver  will  form  a  standard  or  stereotyped 
construction  for  them.  “Aval  lability “  refers  to  the  ease  with  which 
memories  and  stereotyped  cons  truce  ions  of  events  can  be  retrieved  by  an 
individual.  The  “availability  heuristic'*  occurs  when  an  individual, 
attempting  to  judge  the  relative  frequency  of  an  event,  or  the  likelihood 
of  events,  is  influenced  by  the  ease  of  accessibility  of  memory  or 
reconstruction  (Tversky  and  Kahneman,  1973).  In  other  words, 
memorability,  or  ease  of  imaginative  reconstruction  may  influence  the 
estimation  of  frequency  or  likelihood  of  events.  Since  frequency  of 
events  is  correlated  <but  not  perfectly)  with  memorability  and 
construction,  this  heuristic  is  generally  efficient,  more  evimerable  events 
often  are  more  frequent  or  more  likely.  There  are,  however,  a  variety  of 
psychological  factors  that  influence  memorability  that  are  not  associated 
with  frequency,  c.g.»  vividness,  personal  or  perceptual  salience, 
completeness  and  ease  of  encoding*  To  the  degree  that  factors  such  m 
these,  and  net  frequency,  are  the  basis  Car  memorability,  the  use  of  the 
availability  heuristic  as  a  guide  to  estimation  of  frequency  or  likelihood 
will  lead  to  errors. 

This  heuristic  is  diagramed  in  Figure  4.1.  The  impact  of 
frequency  and  other  factors  affecting  memorability  is  shown  in  part  A.  In 
part  S,  when  an  estimate  is  made,  the  memorability  of  events  is  attributed 
only  to  frequency  and  likelihood  C solid  arrow),  rather  than  to  salience, 
vividness,  or  the  other  factors  which  might  also  have  eaes-ed  greater 
eteaof ability.  Although  she  diagram  dees  net  shew  this,  the  availability 
heuristic  my  work  in  converse;  less  memorable  events  are  judged  as  less 
frequent  or  likely  than  more  memorable  ones,  although  several  factors 
other  than  infrequency  can  reduce  memorability. 

Among  the  factors  known  to  influence  memorability  other  than 
frequency  of  events  are  vividness,  salience,  encoding  ease  and 
opportunity,  and  causality.  Vivid  events,  those  that  appear  as 
distinctive  against  a  uniform  background  arc  more  likely  to  be  remembered, 
but  are  not  necessarily  more  frequent* 

Several  aspects  of  Soviet  naval  operations  tend  to  *ake  then  more 
vivid  to  Western  observers.  The  deployment  forward  of  the  Soviet  i«avy  out 
of  Hussion  coastal  waters,  even  though  initially  restricted  to  small 
nuobers  of  units,  attracted  considerable  Western  attention,  chiefly 


5? 


Figure  4«1»  Schematic  Oiagraa  of  Avail ability  Heuristic 
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thr  tgii  its  novelty.  Similarly  the  dramatic  increase  in  the  level  of 
these  out-of-area  deployments  attracted  attention  in  part  because  they 
were  atypical  of  past  Soviet  naval  behavior.  The  vividness  of  these 
sudden  and  dramatic  changes  in  Soviet  behavior  elicited  signif teantiy 
increased  Western  comment.  Such  attention  was  not  given  to  equally 
dramatic  changes  in  the  Soviet  Navy  chat  occurred  against  a  more  varied 
background  or  at  greater  distance,  and  were  thus  less  vivid.  An  example 
is  the  Soviet  Naval  Aviation  (SNA)  which  underwent  significant  changes  at 
the  same  time  the  Soviet  Navy  deployed  forward.  With  a  few  exceptions 
(e.g. ,  Murphy,  NPSP ,  ch.  10)  these  changes  received  very  Uttle  Western 
attention. 

A  second  aspect  of  recent  Soviet  naval  operations  which  increases 
vividness  is  the  tactic  of  “close  embrace"  of  U*S.  naval  ships  by  Soviet 
combatants  in  crisis  areas.  Routinely,  th$.  warships  are  "shadowed"  by 
Soviet  auxiliaries,  usually  intelligence  collectors*  While  this  tactic  is 
effective  near  ports  and  chokepoittts  or  in  narrow  waters,  in  the  open 
ocean  U.S.  task  forces  can  generally  outrun  the  intelligence  collectors  nr 
can  "flush"  (sail  off  in  different  directions)  and  lose  them.  During 
crises,  the  "tattletale"  role  of  the  Soviet  auxiliaries  is  taken  over  by 
warships,  some  of  which  seamed  to  have  been  equipped  with  special  weapons 
(e  g. ,  rear  firing  missile  cyst «®s)  for  the  purpose.  The  switch-over  from 
auxiliary  to  warship  tattletales  coincident  with  rising  crisis  tensions, 
and  the  close  shadowing  of  O.S.  ships  all  combine  to  create  a  particularly 
vivid  event  for  Western  observers*  (The  U*S»  Navy  adopted  a  parallel 
strategy  in  the  1975  Middle  fast  crisis.) 

Because  "close  embrace"  tactics  are  particularly  dangerous  and 
could  lead  to  inadvertent  escalation  of  crises,  they  came  under  diplomatic 
attention  and  a  U.$. -Soviet  —  soment  was  negotiated  to  prevent, 
hopefully,  collisions  at  sea*  <  the  vividness  of  close  embrace  events 
it  not  correlated  with  fr>  cy ,  it  does  parallel  the  serious 
consequences  of  accidents  produced  by  these  events.  Do  the  other  hand, 
such  events  are  not  mm& n  except  in  crises,  and  even  then,  only  one  or 
two  Soviet  warships  are  usually  given  this  mission,  and  these  ships  are 
usually  older,  ACM  types,  rather  than  the  Soviets*  newer  ASM  vessels* 

A  second  feature  of  data  which  can  influence  its  memorability  and 
thus  its  availability  is  salience,  lalience  Is  a  broader  concept  than 
vividness  and  includes  any  distinctive,  physically  prominent,  easily 
perceived  or  visible  feature*  novelty,  uniqueness,  $r  singularity.  An 
event  may  be  salient  if  it  relates  specifically  to  %$m  aspect  of  the 
pereeivtr,  e*g*,  naval  analysts  «he  are  also  aviators  would  probably  find 
data  on  Soviet  naval  aviation  more  salient  than  analysts  with  no  aviation 
background.  Such  data  are  more  distinctive  and  easily  perceived  by 
someone  with  aviation  experience  titan  to  someone  with  none.  ?sv$d  events 
are  salient  but  salient  events  are  not  necessarily  vivid* 

levies  naval  activity  is  mere  salient  to  naval  analysts  than,  say 
Soviet  sserekaat  marine  activities,  and  has  received  the  overwhelming 
attention  of  naval  analysts,  although  some  naval  experts  believe  the 
Soviet  Merchant  Marine  is  the  mere  effective  seagoing  arm  of  §«*w4et 
diplomacy  in  the  third  liar  id  <ef«  Mce#vire,  IfH).  Sven  though  the  Soviet 
merchant  fleet  it  specifically  designed  for  the  peacetime  roles  of 
expanding  Soviet  influence,  increasing  Soviet  ties,  and  exporting  the 
Soviets*  goods  and  views,  the  primary  interest  of  Western  naval  analysts 
is  in  its  capabilities  for  power  ptojectiaa  fe.g.,  Soviet  roiis»», 
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roll-off  ships  as  floating  military  hardware  warehouses).  Analysts  who 
are  quite  adept  at  discerning  peacetime  roles  for  Soviet  warships  (which 
are  designed  primarily  for  wartime  missions)  spend  little  time  examining 
the  less  salient  peacetime  missions  of  the  Soviet  merchantmen,  and 
instead,  accentuate  their  more  salient  wartime  and  crisis  capabilities 
(there  are  some  exceptions  to  thisi  Ackley,  SNI ,  ch.  14;  Davidchik  and 
Mahoney,  Appendix  A,  in  Disoukes  and  McConnell,  1979;  Fairhall,  1971; 
Herzog,  NPSP:  38) 

Naval  analysts  themselves  acknowledge  on  occasion  that  salience 
may  have  an  undue  influence  on  their  estimates.  Dismukes  and  McConnell 
(1979:  xv),  for  example,  caution  that 

The  principle  research  technique  employed  [in  their  book 
Soviet  Naval  Diplomacy]  is  the  intensive  case  study,  focused 
primarily  on  politico-military  actions.  This  approach  has 
inherent  risks:  principally,  the  danger  that  the  importance 
of  naval  power  as  a  direct  instrument  of  policy  will  be 
unconsciously  exaggerated. 

A  more  striking  instance  of  the  impact  of  salience  on  naval 
analysis  is  the  near  absence  of  any  treatment  of  the  Chinese  in  accounts 
by  US.  analysts  of  the  peacetime  intentions  of  the  Soviet  Navy.  This  is 
not  true  of  other  U.S.  analysts,  e.g.,  political  scientists  (although  some 
political  scientists  can  no  doubt  explain  all  Soviet  behavior  without 
reference  to  the  Chinese).  For  example,  a  recent  volume  on  Soviet 
influence  in  the  Third  World  by  nonnaval  analysts,  i-e.,  political 
scientists,  (Rubinstein,  1975),  explicitly  considers  how  Soviet  behavior 
is  shaped  by  considerations  of  the  Chinese.  U  S.  naval  analysts  are 
nearly  unanimous  in  ignoring  the  impact  on  Soviet  naval  activity  or 
intentions  of  the  Soviets'  on-again,  off-again  competition  with  China  in 
the  Third  World.  An  exception  is  the  realization  by  some  analysts  (e.g., 
Graham,  NPSP:  281-83,  290;  Murphy,  NPSP:  127,132)  that,  if  the  Chinese  in 
wartime  cut  the  Trans-Siberian  rail  lines,  the  Soviets'  sole  year-round 
supply  line  to  the  eastern  half  of  Russia  is  through  the  Indian  Ocean. 
Thus  the  Soviet  peacetime  efforts  to  establish  footholds  in  that  region  is 
partly  a  response  to  China  . 

The  Chinese  lack  an  open-ocean  naval  capability  and  show  few  signs 
of  developing  any.  So-’iet  naval  activity  may  directly  aid  the  Soviet  goal 
of  limiting  Chinese  influence  in  the  Third  World,  but  that  Chinese 
influence  does  not  now  involve  naval  forces  or  sea  power.  For  these  two 
reasons  the  "China  factor"  has  extremely  low  salience  for  U.$.  naval 
analysts.  This  does  not  mean  the  Chinese  have  no  influence  on  peacetime 
Soviet  naval  intentions  or  actions,  although  that  influence  is  generally 
lees  significant  than  the  U.S.  role.  In  specific  cases,  however,  the 
Chinese  may  be  a  significant  cause  of  Soviet  behavior. 

While  historical  analogies  are  dangerous,  it  is  interesting  that 
prior  to  World  War  II  the  British,  Dutch.  French,  and  Americans  all  tended 
to  assess  Japanese  naval  intentions  specifically  in  terms  of  their  own 
Pacific  and  Southeast  Asian  interests.  With  the  partial  exception  of  the 
French,  the  Chinese  war  and  the  Korean  and  Manchurian  Japanese  colonies 
had  very  little  place  in  Western  appraisals  of  the  Japanese  Navy.  The 
Japanese  Army's  need  for  petroleum  to  prosecute  its  war  in  China  provided 
a  strong  motivation  for  the  southward  deployment  of  the  Japanese  Navy. 
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While  China  had  virtually  no  navy,  the  "China  factor"  played  an  important 
role  in  the  pre-1941  intentions  of  the  Japanese  Navy,  a  role  Western 
analysts  tended  to  underrate. 

A  fascinating  case  study  of  Soviet  and  Chinese  competition  and  its 
impact  on  Soviet  Navy  peacetime  intentions  could  be  made  using  Indonesia 
as  a  focus.  Soviet  aid  to  Indonesia  in  the  late  1950s  was  mass!  -e, 
exceeding  Soviet  aid  to  Egypt  at  that  time  (a  case  much  Eavored  by  U  S. 
naval  analysts).  Including  aid  from  other  communist  countries,  Indonesia 
received  more  than  $1.5  billion  by  the  end  of  1961,  more  than  any  other 
country  up  to  that  time,  and  more  than  the  $1.3  billion  which  the  USSR  had 
provided  China  between  1949  and  1957  (van  der  Kroef,  1975:  55).  Since 
Soviet  aid  was  concentrated  into  a  brief  decade,  this  investment  in 
Indonesia  is  particularly  impressive. 

Soviet  supplied  ships  gave  Indonesia  the  largest  and  most  modern 
navy  in  the  Indian  Ocean  in  the  early  1960s.  The  Soviets  may  have  run  the 
Sverdlov  cruiser  production  beyond  its  planned  termination  explicitly  to 
deliver  promised  ships  to  Indonesia  (MccGwire,  SND:  190,  194,  209). 

Uprisings  and  military  rebellions  by  anti-communist,  Indonesian 
officers  and  troops  in  the  late  1950s  led  to  near  civil  war.  Soviet  arms 
aid  greatly  strengthened  Che  role  of  the  Communist  Party  in  Indonesian 
politics.  However,  these  arms  also  strengthened  the  most  threatening 
anti-communist  group  in  Indonesia,  the  armed  forces.  Even  more  curiously, 
Moscow  continued  the  arms  supply  while  Sukarno's  policies  leaned 
increasingly  toward  Peking.  Peking  supported  .Sukarno's  campaigns  against 
Malaysia  and  Che  Philippines  diplomatically  while  Moscow  temporized  and 
supplied  the  arms.  This  anomalous  state  came  to  an  end  in  the  1965 
Chinese-backed  coup  attempt  by  leftist  officers  against  the  anti-communist 
officers.  In  the  aftermath  of  that  unsuccessful  attempt  hoth  Moscow  and 
Peking  lost  virtually  all  their  gains  and  Indonesian  relations  with  Moscow 
remained  cold  until  the  mid-1970s  and  even  now  remain  cool. 

It  is  interesting  to  speculate  on  why  Moscow,  which  was  beginning 
to  deploy  its  Navy  forward  in  the  Mediterranean  in  1964,  did  not  project 
its  naval  power  in  1965  and  1966  toward  Indonesia  to  retard  Che  rapid 
erosion  of  Russian  influence  that  followed  the  1965  eeup.  Given  Moscow's 
tremendous  investment  of  aid,  prestige,  and  diplomacy,  and  the  strategic 
significance  of  the  entrances  to  the  Indian  Ocean,  the  Soviets  would  seem 
to  have  had  more  than  sufficient  motivation  to  attempt  naval  diplomacy  in 
this  ease.  Possibly  the  Soviets  lacked  the  capabilities  (Soviet 
deployments  to  the  Indian  Ocean  did  hut  begin  until  1968);  or  they  lacked 
the  will  to  begin  their  first  exercise  in  coercive  naval  diplomacy  so 
close  to  the  M  §»  involvement  in  Southeast  Asia;  or  perhaps  they  were  not 
interested  in  Third  World  naval  diplomacy  per  go,  but  only  as  such  efforts 
accomplished  war-related  ends  (e.g.,  obtaining  bases  for  forces  which 
could  deal  with  U.S.  carrier  and  submarine  nuclear  threats  to  the  USSR) . 
In  any  event,  the  Indonesian  ease  (or  perhaps  neoea&e)  has  been  largely 
neglected  by  analysts  of  the  Soviet  N.-.vy, 

Certain  events  are  easier  ;o  recall  than  others,  or  can  be 
recalled  more  completely,  not  because  of  differences  in  encoding,  but 
because  of  decoding  (nr  retrieval)  factors.  One  factor  that  aids  in 
memory  retrieval  is  hindsight;  knowing  hew  events  turned  out.  Knowledge 
of  outcomes  facilitates  reconstruction  from  memory  of  events  consistent 
with  those  outcomes.  Events  which  were  not  consistent  with  outcomes  may 
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not  be  as  effectively  recalled. 

This  hindsight  bias  has  been  detailed  experimentally  by  Fischhoff 
and  his  colleagues  (Fischhoff  and  Beyth,  1975;  Fischhoff,  1975a,  b,  1977  , 
1980a;  Slovic  and  Fischhoff,  1977).  Knowing  how  an  event  turned  out 
increases  the  perceived  likelihood  of  the  reported  outcome  and  changes  the 
perceived  relevance  of  event  descriptive  data.  People  are  largely  unaware 
of  the  effect  that  outcome  knowledge  has  on  their  perceptions,  and  they 
consequently  overestimate  what  they  would  have  known  without  outcome 
knowledge.  They  also  overestimate  what  others  actually  did  know  without 
outcome  knowledge. 

It  is  not  uncommon  for  analysts  to  be  unaware  of  the  hindsight 
bias,  and  also  to  believe  that  greater  knowledge  of  outcomes  will  improve 
the  analysis  of  how  those  outcomes  came  about.  In  fact,  the  hindsight 
bias  may  impede  the  analysis  of  events  by  making  important  descriptive 
data  seem  inevitable,  trivial,  or  irrevelant.  Knowing  how  events  turned 
out  may  make  analysis  less,  rather  than  more,  insightful.  Nevertheless, 
recommendations  by  analysts  to  defer  analysis  until  events  turn  out  are 
occasionally  encountered,  like  the  following  observation  by  MccGwire  (SNP: 
p.  viii)  on  the  Gorshkov  series  of  articles: 

A  definitive  assessment  of  the  articles  would  have  to  wait 
on  greater  hindsight  and  more  external  evidence. 

The  problem  with  this  is  that  the  "definitive  assessment"  of  the  series 
will  probably  perceive  a  greater  degree  of  coherence  and  clarity  in 
Gorshkov's  writing  than  actually  exists.  The  analyst's  knowledge  of 
outcomes  and  the  changes  that  take  place  in  "external  evidence"  subsequent 
to  Gorshkov's  writings  will  perhaps  assist  in  understanding  Gorshkov's 
meanings,  but  will  not  make  those  writings  any  clearer  a  key  to  future 
developments.  As  Fischhoff  (1980a)  observes 

....  it  is  generally  assumed  that  the  past  will  readily 
reveal  the  answers  it  holds  .  .  .  One  can  explain  and 
understand  any  old  event  if  appropriate  effort  is  applied  . 

.  .  we  should  hold  the  past  in  a  little  more  respect  when  we 
attempt  to  plumb  its  secrets.  While  the  past  entertains 
ennobles,  and  expands  quite  readily,  it  enlightens  only  with 
delicate  coaxing. 

In  a  later  section  of  this  chapter  we  will  describe  at  some  length 
a  variety  of  historical  fallacies  and  show  how  they  occur  in  naval 
analysis  of  Soviet  peacetime  intentions, 

The  more  easily  data  can  be  encoded  into  memory  the  more  readily 
it  can  be  recalled.  Similarly  more  completely  encoded  data,  i.e.,  data 
that  are  fitted  into  an  existing  mental  framework,  are  more  easily 
remembered.  Neither  ease  of  encoding  nor  completeness  are  indicative  of 
frequency.  If  easily  encoded  or  completely  encoded  data  are  easily 
recollected  it  is  erroneous  to  allow  this  availability  to  influence 
judgments  of  frequency  or  likelihood. 

Psychologists  have  evolved  many  labels  for  encoding  processes 
which  aid  in  the  perception  and  storage  of  data:  schemas,  stereotypes, 
scripts  prototypes,  and  personas  are  some  of  the  terms  used.  These 
concepts  differ  slightly  from  each  other  but  they  all  represent  concepts 


62 


Gi- 


iii 


familiar  to  the  perceiver  which  enable  the  efficient  categorization  of  an 
event  or  stimulus  as  the  member  of  a  class. 

There  are  several  heuristics  peculiar  to  concept  formation  and 
encoding  which  will  be  reviewed  in  the  section  below  on  characterizing 
data;  the  main  point  here  is  that  the  availability  of  well-used  schemes  or 
concepts  for  perceiving  and  encoding  data  may  facilitate  the  operation  of 
the  availability  heuristic  and  thus  bias  frequency  or  likelihood 
judgments. 

International  crises  provide  a  familiar  concept  for  the  analysis 
of  peacetime  Soviet  naval  intentions.  Soviet  naval  events  during  these 
periods,  especially  those  which  take  place  in  proximity  to  the  crisis 
area,  may  be  encoded  as  crisis-related.  An  example  of  this,  reviewed  in 
Chapter  3,  was  the  proximity  of  a  Soviet  naval  exercise  in  1970  to  the 
Libyan  coup.  This  was  perceived  by  some  analysts  as  indicating  a  Soviet 
intention  to  support  the  coup  makers. 

Similarly,  a  Soviet  exercise  held  in  proximity  to  the  "Cod  War" 
between  Britain  and  Iceland  in  1973  has  been  interpreted  as  related  to 
that  crisis  (Dismukes  and  McConnell,  1979:  355:  Disraukes,  SNI :  493-4) 
even  though  no  Soviet  goals  for  involvement  in  the  crisis  were  evident, 
and  the  exercise  took  place  in  a  traditional  Soviet  exercise  area  in  the 
traditional  exercise  season.  The  exercise  had  no  clear  relationship  to 
the  British  or  the  Icelandic  activity.  During  the  "second  Cod  War"  the 
Soviets  conducted  no  exercises  in  the  area,  but  this  occurred  in  November 
rather  than  the  spring  exercise  season. 

Events  which  seem  to  be  causes  of  other  events  are  likely  to  be 
more  easily  perceived  and  memorable  than  events  which  have  no  causal 
significance.  In  a  later  section  evidence  will  be  reviewed  that  suggests 
causal  scenarios '-are  readily  Imagined  to  explain  effects,  and  are  readily 
perceived  in  an  array  of  data.  This  ease  of  generating  causal 
explanations  may  be  taken  as  an  index  of  the  aptness  or  likelihood  of  such 
scenarios  as  explanations. 

The  variety  of  explanations  proposed  by  naval  analysts  for  Soviet 
peacetime  naval  developments  (Chapter  3)  suggests  how  easily  plausible 
causes  can  be  perceived  in  complex  data.  Many  of  these  proposed 
explanations  are  partially  or  wholly  inconsistent  with  each  other.  It 
seems  likely  that  excessive  causality  is  perceived  in  the  Soviet  Navy's 
influence  on  the  U.S.  Navy  during  crises  (e.g.,  the  1967  or  1973  Middle 
F.aat  Wars).  There  is  a  strong  tendency  by  some  naval  analysts  to  accept 
the  Soviets'  own  claims  that  Soviet  naval  presence  prevents  U.S.  naval 
intervention  during  these  crises.  Some  analysts  even  suggest  that  Soviet 
naval  forces  off  Angola  in  1975  anticipated  a  U.S.  naval  intervention  and 
forestalled  it  before  it  was  even  attempted.  To  be  sure,  the  Soviet  Navy 
may  be  the  "cause"  for  U.S.  nonintervention,  or  it  may  make 
nonintervention  (decided  on  for  other  reasons)  an  easier  policy  to  follow 
(i.e.,  the  Soviet  presence  facilitates,  but  does  not  cause, 
nonintervention).  But  the  Soviet  presence  may  have  no  effect  on  the 
decision  not  to  intervene,  or  even  a  negative  effect  (i.e.,  some  may  see 
the  Soviet  presence  as  an  unjustified  prohibition  that  should  be 
challenged  to  demonstrate  U.S.  resolve  and  freedom  of  action).  It  cannot 
be  demonstrated  on  the  evidence  to  date  that  the  Soviet  Navy  hus  caused 
U.S.  nonintervention  in  any  crisis,  yet  this  perception  persists. 
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The  Representativeness  Heuristic 


This  second  judgment  strategy  described  by  Kahneman  and  Tversky 
(1972,  1973;  Tversky  and  Kahneman,  1974)  involves  the  use  of  salient 
features  of  a  sample  of  data  to  infer  its  membership  in  some  data 
category.  This  strategy  is  a  relatively  simple  application  of  resemblance 
or  “goodness  of  fit"  criteria  to  categorization  judgments.  A  particular 
case  is  examined  for  salient  features,  which  are  used  to  infer  the 
membership  class  of  that  case. 

The  use  of  the  representative  heuristic  leads  to  accurate 
judgments  so  long  as  the  salient  features  of  the  sample  are  true 
reflections  of  the  population  from  which  it  was  drawn.  However,  many 
samples  from  a  population  will  be  atypical  on  the  salient  features,  and 
virtually  all  samples  will  be  atypical  on  at  least  one  feature  (i.e.,  the 
sample  case  that  is  exactly  average  on  all  dimensions;  like  the  "average" 
scientist  who  is  33.3  years  old,  married  to  .95  of  a  wife,  with  2.1 
children,  is  an  extremely  improbable,  if  not  impossible,  case). 

The  problem  with  the  use  of  the  representativeness  heuristic  is 
the  tendency  it  produces  to  overlook  sample  information  that  is  unrelated 
to  sample  features,  but  i£  related  to  the  base-rate  of  that  sample,  i.e., 
the  likelihood  of  that  particular  sample  in  the  population.  For  example, 
the  salient  features  of  iron  pyrite  are  quite  similar  to  those  of  gold. 
People  who  mistake  "fool's  gold"  for  the  real  thing  are  placing  too  great 
a  weight  on  the  specific  features  of  the  sample  (its  representative  gleam, 
color,  shape,  etc.)  and  too  little  weight  on  the  base-rate  data  (the 
relative  abundance  of  iron  pyrites  and  the  scarcity  of  gold)  which  is 
unrelated  to  the  sample  features.  The  representative  heuristic  applied  in 
this  case  leads  to  the  conclusion  that  "what  glitters  is  gold."  Sometimes 
this  is  true,  but  as  the  wise  know,  not  often  —  appearances  can  be 
deceiving. 

An  example  of  the  representative  heuristic  can  be  found  in  Vigor's 
(SNP:  ch.  32)  analysis  of  Admiral  Gorshkov's  discussion  of  "command  of  the 
sea"  [gospodstvo  na  more].  Vigor  writes  (p.  619) 

.  ..  the  way  in  which  he  elaborates  it  .  .  .  seem(s)  to  me 
to  provide  a  valuable  clue  to  some  likely  paths  of  future 
development  of  Soviet  naval  strategy. 

In  other  words,  the  salient  features  of  Gorshkov's  elaboration  of  "command 
of  the  sea"  appear  (to  Vigor)  representative  of  future  Soviet  naval 
strategy.  Vigor  assesses  Gorshkov  ae  supporting  "command  of  the  sea"  for 
the  Soviet  Navy  and  advocating  command  over  principle  theaters  of 
operations,  and  an  ability  to  stop  the  enemy's  navy  from  carrying  out 
operations. 

MccGwire  (SNP ,  ch.  33:  633-34)  questions  Vigor's  reading  of 
Gorshkov  primarily  on  base-rate  grounds; 

The  term  is  used  relatively  infrequently  (by  Gorshkov  and 
others]  and  almost  wholly  in  its  prcjorative  (Hahonist) 
sense,  or  else  descriptively  ....  In  Soviet  usage, 
"command  of  the  sea"  docs  not  carry  the  emotive  baggage  that 
it  has  in  the  English  language.  .  .  the  Soviet  Navy  is  more 
likely  to  speak  in  terms  of  "defending  the  country's 
maritime  frontiers,"  "concentration  of  forces,"  or  "combat 
stability." 
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MccGwire  concludes  (p.  632  33)  that  the  Soviets  fail  to  see  any  practical 
relevance  to  modern  warfare  in  the  concept  of  command  of  the  sea.  Nor  do 
they  see  it  as  realistic  given  modern  weapons  that  can  create  a  vast  "no 
command"  zone.  Since  command  of  the  sea  "is  not  a  major  factor  in  Soviet 
naval  strategy,”  according  to  MccGwire,  there  is  little  point  to 
consulting  elaborations  on  it  for  future  Soviet  naval  strategy 
developments.  In  MccGwire's  view  the  concept  is  uncharacteristic  of  the 
Soviets,  and  Soviet  strategy  of  the  future  is  unlikely  to  include  it.  It 
appears  representative  only  if  one  overlooks  the  general  character 
(base-rate)  of  Soviet  strategy. 

Naval  analysis  provides  a  strong  opportunity  for  the  misguided 
application  of  the  representative  heuristic  because  of  a  prevalent 
tradition  of  case  study  and  class  analysis.  Case  studies  include  detailed 
analyses  of  crises,  theaters,  client-patron  state  relations,  etc.  Class 
analysis  focuses  on  Soviet  submarines,  aircraft  carriers,  surface  classes, 
aviation,  etc.  The  danger  is  that  salient  features  of  a  particular  case 
or  class  will  be  taken  as  indicative  of  the  membership  of  that  case,  and 
the  base-rate  likelihood  of  such  membership  will  be  neglected. 

Crisis  analysis  may  be  extremely  susceptible  to  the  representative 
bias.  Crises  are  rare  and  infrequent  and  have  very  little  in  common  with 
either  day-to-day  peacetime  missions  or  wartime  missions.  Naval  forces 
designed  for  flexible  execution  of  peacetime  and  wartime  missions  way 
perform  crisis  tasks  quite  well,  generating  the  perception  that  the  forces 
were  designed  for  crisis  purposes*  (For  example,  U.S.  helicopters  and 
aircraft  carriers  in  the  South  China  Sea  performed  the  evacuation  of 
Saigon  quite  well  but  it  would  be  a  mistake  to  attribute  this  successful 
flexibility  to  some  premeditated  design  of  forces  for  just  such  crises.) 
Crises  always  carry  a  heavy  burden  of  the  unknown  and  unanticipated; 
neither  of  the  great  powers  can  be  said  to  have  effectively  anticipated  or 
planned  for  any  major  Third  World  crises. 

Since  many  naval  forces  never  practice  their  wartime  missions 
realistically  even  in  training  (e  g.,  only  one  live  warhead  has  ever  been 
fired  from  a  U.S.  ballistic  missile  submarine),  and  since  peacetime 
missions  are  often  inconspicuous,  crises  performances  may  be  highly 
salient  but  greatly  misleading  in  the  analysis  of  the  intentions  guiding 
those  naval  forces. 

It  has  been  argued  that  surface  anticarrier  warfare  (ACW)  is  a 
diminishing  feature  of  Soviet  naval  forces,  in  terms  of  construction, 
exorcises,  and  doctrinal  writings.  The  use  of  surface  ACM  units  still 
seems  to  occur,  however,  during  crises.  It  is  unlikely  that  surface  ACM 
is  representative  of  the  Soviet  Navy  in  any  tactical  sense,  .Surface  ACW 
may  be  unique  to  great  power  naval  crisis  demonstrations  and  may  no  longer 
signify  a  Soviet  resolve  to  prevent  U.S.  intervention  in  crises  (if  it 
ever  actually  did). 

Representativeness  and  ava liability.  The  aval  lability  and 
representative  heuristics  may  combine,  as  Nisbett  and  Ross  (19S0;  26) 
write; 


.  .  .  a  person  who  is  required  to  account  for  sesae  observed 
action  or  outcome  may  search  the  list  of  available 
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antecedents  for  those  that  seem  to  be  the  most 

representative  "causes"  of  the  known  "consequences." 

There  Is  a  very  strong  tendency  to  match  causes  with  consequences: 
motivational  causes  are  given  for  events  with  strong  motivational  or 
emotional  consequences;  complicated,  multifaceted  causes  for  complicated 
events.  The  fallacy  of  identity,  that  causes  must  resemble  effects,  is 
describe'  in  a  later  section.  This  tendency  has  also  been  termed  "magical 
thinking"  by  Shweder  (1977). 

The  combination  of  these  two  heuristics  may  arouse  mental  theories 
and  schemas  to  help  organize  perceptions.  Theories  are  fairly  explicit 
propositions  about  objects  and  classes  (e.g.,  Soviet  forward  deployments 
are  part  of  Soviet  naval  diplomacy).  Schemas  are  less  propositional  and 
t'.ore  schematic  (e.g.,  the  meaning  of  "defensive").  Perceptions  are 
readily  assimilated  into  pre-existing  impressions,  beliefs,  and  theories. 
In  later  sections  we  discuss  the  impact  of  these  preconceptions  on 
estimates  of  covariation,  causality,  and  prediction.  At  the  stage  of 
perception,  the  assimilation  effects  of  theories  and  schemas  means  that 
data  that  do  not  fit  the  theory  may  not  even  be  perceived,  and  are  thus 
unavailable  at  later  estimation  stages.  The  lack  of  much  analysis  by  the 
U.S.  naval  analysts  of  the  Indonesian  case  and  the  impact  of  China  on  the 
Soviet  Navy  is  consistent  with  the  lack  of  theories  or  schemas  that 
encompass  these  data. 

The  arguments  among  naval  analysts  on  whether  Khrushchev  secretly 
favored  surface  ships  and  whether  Admiral  Gorshkov  saved  surface  ships 
from  the  breakers'  yards  seem  to  reflect  the  combination  of  availability 
and  representativeness <  heuristics  evoking  a  causal  theory  which  affects 
the  perception  of  data.  As  discussed  in  Chapter  3,  Case  1,  the  claim  was 
made  in  1967  by  Gorshk  v  that  the  Soviets  decided  in  1954  to  create  a 
balanced  "ocean-going"  fleet  capable  of  protecting  state  interests  abroad 
in  peacetime.  This  "theory"  serves  Herrick  (1968:  71)  as  an  explanation 
for  Gorshkov's  cautious  campaign  to  save  the  surface  ships  despite 
Khrushchev's  distaste  for  them.  The  same  theory  serves  McConnell  (in 
Pisoukes  and  McConnell,  1979:  13)  as  a  basis  for  the  thesis  that 
Khrushchev  was  less  deprecating  of  surface  ships  than  he  appeased  to  be, 
•nd  that  in  1954  Moscow  set  in  train  the  plan  for  power  projection  in  the 
third  World  through  naval  diplomacy  (i.e.,  Gorshkov  can  be  taken  at  his 
word). 

HccGwire  <SND:  189-194)  challenges  both  Herrick's  and  McConnell's 
conclusions,  citing  inconsistent  data  —  the  Soviets  stopped  large  surface 
ship  programs  in  1954  and  did  not  resume  them  for  some  years.  The 
decisions  for  forward  deployment  were  made  for  strategic  purposes,  not  as 
part  of  a  naval  diplomacy  plan*  Gorshkov  had  little  visible  influence 
over  the  Patty's  decisions  to  cut  back  surface  ships  and  even  today  he  is 
still  attempting  to  create  a  balanced,  ocean-going  fleet.  HccGwire 
interprets  Gorshkov's  1967  remarks  as  hiudaightfol,  post  hoc 
rationalisations  designed  to  demonstrate  communist  wisdom  in  foreseeing 
the  future,  and  to  put  a  favorable  face  an  the  open -ocean  missions  thrust 
on  the  Soviets  by  Western  strategic  capabilities*  in  effect,  HccGwire  is 
arguing  that  the  perception  of  Gorshkov  as  the  savior  of  the  surface 
ships,  and  Khrushchev  as  a  crypto-supporter  of  then,  is  due  to  Gorshkov's 
conveniently  providing  (in  1967,  after  the  Admiral  knew  how  events  turned 
out)  an  available  and  representative  explanation  that  seemed  to  fit  events 
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(at)  they  appeared  in  1967)  but  which  is  actually  inconsistent  with  the 
course  of  events  from  1954  through  the  early  1960s* 

Assigning  Weights  to  Data 

Analysts  and  estimators  not  only  perceive  data,  they  must  decide 
which  data  are  significant  and  important!  and  which  to  ignore.  As  was 
noted  earlier  in  this  chapter,  a  major  source  of  error  in  forecasting, 
perhaps  the  major  source,  is  the  set  of  key  assumptions  made  by  the 
forecaster  (Ascher,  1978:  199).  Key  assumptions  can  be  thought  of,  in 
part,  as  decisions  the  forecaster  makes  about  important  dimensions  or 
variables.  Once  the  key  variables  are  decided,  the  forecaster  collects 
data  on  these  variables,  and  not  on  others.  Ascher  writes  (p.  199) 

The  core  assumptions  underlying  a  forecast,  which  represent 
the  forecaster's  basic  outlook  on  the  context  within  which 
the  specific  forecasted  trend  develops,  are  the  major 
determinants  of  forecast  accuracy. 

There  is  more  to  the  concept  of  “core  assumptions“  than  just  weighing 
data;  e.g.,  the  forecaster  must  also  decide  which  variables  are  related  to 
each  other  and  in  what  ways.  But  weighing  data  and  deciding  on  which 
variables  and  dimensions  to  attend  are  important  elements  of  the  key 
assumptions  analysts  and  estimators  make. 

As  our  ‘'mini-reviews“  in  chapter  3  suggested,  naval  analysts  weigh 
variables  differently.  Some  analysts  (e-g.  NeeGwire)  emphasise  the 
Soviet  Navy's  ship  construction  practices  asvt  use  the  sice,  shape,  and 
capabilities  os  the  vessels  m  clues  to  Soviet  plans  and  purposes.  To  the 
degree  that  Soviet  ships,  submarines,  and  aircraft  are  const  rue  tod  lot 
narrowly  defined  tasks,  and  have  limited  mission  flexibility,  these 
patterns  and  trends  provide  a  useful  indicator  of  at  least  the  major 
anticipated  wartime  missions  of  the  Soviet  fleet.  The  “hardware “  method 
is  less  predictive  when  the  Soviets  use  their  ships  to  accomplish  missions 
for  which  they  were  not  designed,  or  lor  missions  that  were  not 
anticipated  when  the  ships  were  built.  Similarly,  if  the  Soviets  engineer 
more  ships  fur  greater  mission  flexibility  (e.g»,  the  Kiev  class),  the 
hardware  methodology  will  bo  loss  successful  in  Helping  rule  out  possible 
missions. 

In  contrast  to  the  “hardware”  analyst,  who  puts  great  weight  on 
the  physical  stuff  of  the  Soviet  Navy,  “software’*  analysts  (e.g.,  Hudson, 
Sff&t  eh.  21,  1971)  examine  the  verbal  behavior  of  the  Soviet  Navy's 
spokesmen,  namely  their  naval  doctrine,  for  indicators  of  future  naval 
©pare clous.  Whose  statements  actually  constitute  doctrine  is  a  major 
analytic  question,  as  the  debate  over  the  author! tat iveness  of  Admiral 
Gorshkov's  writings  demonstrates  (see  chapter  S,  ease  4  for  a  review), 
Analyses  who  have  decided  Gorshkov  is  expressing  doctrine  tend  to  take  him 
at  his  ward  with  respect  to  the  future  directions  of  the  Soviet  Navy, 
hstimaters  who  read  Gorshkov  as  an  ad  wears  take  the  view  that  Gorshkov's 
prophecies  and  intimations  can  be  expected  to  occur  only  if  he  wins  his 
case  with  the  y*S8s*s  defense  and  political  leadership.  In  other  words, 
actions  and  events,  nut  Gorshkov's  statements,  will  determine  whether  the 
statements  were  predictive.  Seme  analysts  (e.g.,  Gallagher,  Shi s  efe.  3) 
view  doctrine  at  a  very  slippery  guide  to  the  future,  even  when  it  is 
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known  to  be  authentic*  Gallagher  (p.  56)  sums  up  the  problems  with 
weighing  doctrine  too  heavily  as  an  Indicator  of  future  Soviet  naval 
behavior: 

(doctrine]  is  a  charter  attesting  the  military's  right  to 
participate  in  policy  formation  and  general  authorization 
for  a  broad  and  comprehensive  development  of  the  armed 
forces.  To  interpret  it  as  a  key  to  Soviet  strategic  policy 
would  be  both  to  misread  the  doctrine  and  to  underestimate 
the  dynamics  of  the  Soviet  decision-making  process. 

There  are  a  variety  of  nonobvious  psychological  problems  that  may 
occur  when  analysts  assign  weights  to  data.  Analysts  may  believe  they 
weight  heavily  data  which  they  actually  attend  to  very  little.  Analysts 
may  over-weight  data  which  are  (a)  from  small  samples;  (b)  apparently 
relevant  (e.g.,  causal),  vivid  or  highly  salient;  (c)  based  on  a  case 
(rather  than  on  a  base-rate);  (d)  from  certain  evaluative  (e  g.,  good-bad) 
dimensions;  or  (e)  single  dimensional.  In  this  section  we  review  these 
problems  and  examine  how  they  apply  to  Soviet  naval  analysis. 

Knowing  more  than  you  can  know  —  introspection  on  data  weights. 
People  who  solve  problems,  make  judgments  or  decisions,  or  form  estimates 
can  be  asked  to  report  what  factors  or  data  dimensions  most  influenced 
them.  Alternatively,  while  people  are  solving  a  problem,  making  a 
decision,  or  forming  an  estimate,  they  can  be  asked  to  "think  out  loud," 
and  thus  provide  a  record  of  the  factors  they  considered.  These 
techniques  are  known  as  “process  tracing."  Psychologists  have  also 
developed  the  technique  of  presenting  people  with  a  problem,  decision,  or 
estimation  task  with  carefully  controlled  variations  i-  input  data.  For 
example,  Judges  may  be  asked  to  evaluate  the  nutritional  quality  of 
breakfast  cereals  with  carefully  varied  levels  of  vitamins,  minerals, 
calories.,  fats,  etc.  By  comparing  the  judgmental  outputs  with  the  data 
inputs,  psychologists  can  determine  the  degree  to  whic,  judges  weighed  the 
data,  without  asking  the  judges.  This  technique  is  termed  "policy 
capturing,"  "decision  modeling,”  or  "linear  regression"  (after  the 
mathematical  technique  used  to  determine  how  the  data  relate  to  the 
judgments)- 

A  significant  difference  emerges  from  studies  of  Judgment  when  the 
process-tracing  technique  is  used  and  when  linear  regression  techniques 
are  employed.  The  data  that  the  linear  regression  method  shows  are  most 
heavily  weighted  are  sometimes  not  the  data  people  report  as  most  heavily 
weighted.  In  fact,  people  occasionally  report  being  influenced  by  data 
which  are  mathematically  unrelated  to  their  decisions,  or,  alternatively, 
people  report  ignoring  a  set  of  data  that,  in  fact,  can  he  shown 
mathematically  to  be  the  most  important  component  of  their  judgments.  In 
other  words,  people  may  have  poor  insights  into  their  own  problem-solving, 
judgment,  or  estimation  processes,  this  problem  becomes  critical  when  the 
parson  attempts  to  improve  these  processes.  Exactly  when  and  how  these 
discrepancies  between  (a)  judgments  and  (b)  reports  on  judgments  occur  are 
not  yet  well  known  (Etnhorn  and  Hogarth,  1978)  although  they  are  under 
intensive  discussion  and  investigation  hy  psychologists  (e.g.,  hisbett  and 
Wilson,  1977a,  b;  Smith  and  Miller,  1978;  ttt'ght  and  Rip,  1980). 

Many  Studies  have  found  discrepancies  between  "objective"  or 
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"computed"  weights  given  to  data  by  judges  (as  determined  by  linear 
regression),  and  the  "subjective"  weights  reported  by  the  judges  when 
asked  to  describe  the  data  they  used  in  the  task  (see  Slovic  and 
Lichtenstein,  1971:  683-84  for  a  review).  Judges  strongly  overestimate 
the  importance  they  place  on  minor  variables  (in  terms  of  computed 
weights)  and  underestimate  their  reliance  on  a  few  major  data  dimensions. 
People  are  generally  quite  unaware  that  their  judgments  in  many  multi-cue 
estimation  and  decision-making  tasks  can  be  predicted  using  only  a  few 
dimensions  of  the  input  data.  Slovic  and  Lichtenstein  (1971:  684) 
report: 


Across  a  number  of  studies,  varying  in  the  number  of  cues 
that  were  available,  three  cues  usually  sufficed  to  account 
for  more  than  80%  of  the  predictable  variance  in  the  judges' 
responses.  The  most  important  cue  usually  accounted  for 
more  than  40%  of  this  variance. 

The  tendency  to  believe  that  more  data  dimensions  or  cues  were 
used  than  actually  were  to  make  an  estimate  or  judgment  may  contribute  to 
overconfidence,  a  phenomenon  discussed  later  in  this  chapter  under  theory 
maintenance  and  change. 

An  interesting  sidelight  on  the  lack  of  self-insight  on  data 
weighting  policies  was  provided  in  a  study  of  13  stockbrokers  (Slovic, 
Fleissner,  and  Bauman,  1972).  The  accuracy  of  these  brokers' 
self-insights  into  their  policies  for  recommending  investments  was 
measured  by  correlating  a  broker's  subjective  weights  with  his  computed 
weights  across  eight  cue  factors.  The  correlation  between  this 
self-insight  accuracy  score  and  stockbroker  experience  (number  of  years) 
was  -.43;  i.e.,  brokers  with  greater  experience  had  less  insight.  Slovic, 
et  ai.,  suggest  that  less  experienced  brokers  may  be  following  the 
evaluation  strategies  they  were  taught  more  self-consciously,  and  giving 
greater  attention  to  the  mechanics  of  judgment.  With  more  experience, 
these  skills  become  more  automatic,  demand  less  attention,  and  may  become 
harder  to  describe  accurately.  On  the  other  hand,  experience  should  also 
increase  the  availability  of  plausible  decision  strategies  which  the 
brokers  may  report  (inaccurately)  as  their  own. 

Nisbett  and  Wilson  (1977a)  labeled  this  lack,  of  self-insight  on 
judgment  policies  "telling  more  than  we  can  know."  They  suggest  that 
there  may  be  little  or  no  direct  introspective  access  to  higher  order 
cognitive  processes:  people  may  be  unaware  that  certain  data  have  an 
important  influence  on  estimates.  Instead  of  reporting  what  actually 
influences  judgments,  they  way  report  a  priori,  implicit  causal  theories 
or  judgments  about  the  extent  to  which  a  particular  fact  is  plausible 
evidence  for  a  given  estimate.  While  people  may  have  no  direct  access  to 
their  estimation  cognition,  they  may  nevertheless  accurately  report  about 
them  when  the  "social  theory"  conforms  to  the  "cognitive  process."  As 
JUabett  and  Wilson  wrote  (p-  231); 


Accurate  reports  will  occur  when  influential  stimuli  are 
salient  and  are  plausible  causes  of  the  responses  they 
produce,  and  will  not  occur  when  stimuli  are  not  salient  or 
are  not  plausible  causes. 
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(We  will  have  more  to  say  about  salience  and  data  weighting  later.) 

Nlsbett  and  his  colleagues  (Nisbett  and  Bellows,  1977;  Nisbett  and 
Wilson,  1977a,  b)  reported  a  variety  of  psychological  experiments  that 
demonstrate  how  people's  judgments  can  be  influenced  significantly  by  data 
without  their  awareness  of  this  Influence.  In  some  cases  the  direction  of 
influence  may  be  opposite  to  that  believed  by  the  person  making  the 
judgments.  Clearly,  if  people  do  not  accurately  know  why  they  reach  an 
estimate  it  will  be  difficult  for  them  to  change  or  Improve  their 
estimation  process. 

The  Nisbett  and  Wilson  (1977a)  thesis  remains  controversial  (e.g., 
Smith  and  Miller,  1978)  and  seems  only  to  occur  sometimes,  i.e. ,  sometimes 
people  do  seem  to  report  more  than  merely  a  "social  theory"  (e.g.,  Wright 
and  Rip,  1980).  Psychologists  who  utilize  the  process-tracing  method  are 
particularly  reluctant  to  accept  the  idea  that  they  are  investigating 
social  theories  rather  than  studying  estimation  or  judgment  processes 
(e.g.,  Svenson,  1979:  97-8). 

A  second  factor  determines  the  ability  of  process-tracing  to 
capture  the  actual  cognitive  process  of  the  judge:  the  ability  of  the 
process-tracing  experimenter  to  adequately  translate  the  judge's  verbal 
reports  into  a  process-trace  (Einhorn,  Kleinmuntz,  and  Kleinmuntz,  1979: 
476).  The  task  of  process-tracing  itself  involves  judgment  and  possible 
error,  and  while  the  judge's  reports  may  faithfully  reflect  mental 
processes  (contrary  to  Nisbett  and  Wilson's  thesis)  experimenters  may  be 
unable  to  translate  these  statements  into  a  process  model  that  accurately 
predicts  judgments.  Einhorn,  et  al.  ,  note  that  highly  predictive 
process-tracing  models  of  a  judge's  estimation  process  will  occur  only  if 
the  judge's  insight  is  accurate  and  the  process-tracing  experimenter  is 
able  to  accurately  capture  that  insight.  If  either  insight  or 
process-t racing  ability  are  low,  the  process-trace  will  have  only  partial 
predictive  success.  If  both  are  low  the  process-trace  will  not  predict 
judgments. 

Nevertheless,  the  concept  of  inaccurate  self-insights  into  data 
weighting  has  experimental  support  and  serves  os  a  partial  explanation  for 
conflicts  in  naval  estimates.  That  is,  naval  analysts  who  examine  similar 
or  identical  data  dimensions  (e.g.,  Admiral  Gorshkov's  writings,  or  Soviet 
deployments  in  the  Indian  Ocean)  may  reach  very  different  conclusions  and 
predictions  as  we  saw  in  Chapter  3.  A  partial  reason  for  these 
disagreements  may  bs  the  analysts'  inability  to  determine  exactly  which 
cues  they  weighted  most  heavily  in  their  estimates.  Two  analysts,  whs 
both  believe  they  gave  the  same  weights  to  the  same  cues,  may  reach 
different  estimates  because  their  self-insights  into  cue  weightings  are 
inaccurate. 

In  addition,  a  Soviet  Navy  analyst  may  be  influenced  by  the 
increased  salience  of  a  cue  that  previously  seemed  unimportant,  but  may  he 
unaware  of  his  new  attentiveness  and  sensitivity  to  the  cue.  the  analyst 
•*y  thus  perceive  a  ’'change*  In  soviet  behavior  where  none  in  fact 
exists. 

The  structure  of  the  data  an  analyst  uses  to  make  an  estimate  may 
influence  how  those  data  are  weighted*  even  when  these  structural 
characteristics  should  he  Irrelevant  to  cue  utilisation  they  seem  to  have 
strong  effects  on  cue  weights.  These  structural  aspects  of  data  include 
correlations  between  cues,  cue  variability,  number  of  cues*  and 
cue-response  compatibility  (see  Slavic  and  Lichtenstein*  1971;  6bi-6S5  for 
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experimental  studies  and  references). 

Redundant  cues.  When  people  have  important  cues  which  agree,  they 
tend  to  weight  them  equally  and  use  both.  When  the  cues  disagree  people 
tend  to  focus  on  only  one  or  to  use  other  cues  to  resolve  the  conflict. 
High  agreement  between  cue3  is  a  major  factor  in  increasing  confidence  in 
predictions  based  on  these  inputs.  For  example,  people  express  more 
confidence  in  predicting  the  grade  point  average  of  a  student  who  received 
all  B's  than  in  predicting  the  average  of  a  student  whose  record  included 
many  A's  and  C's  (Kahneman  and  Tversky,  1973).  However,  highly  consistent 
data  patterns  are  most  often  observed  when  the  data  input  variables  are 
highly  redundant  or  correlated.  If  two  data  variables  are  perfectly 
correlated  they  are  totally  redundant  and  knowledge  of  one  is  sufficient. 
If  two  perfectly  redundant  variables  are  weighted  equally  and  are  both 
used  in  making  predictions,  the  estimator  has,  in  effect,  counted  a  single 
piece  of  information  twice.  People  tend  to  have  great  confidence  in 
predictions  based  op  redundant  variables.  However,  a  prediction  based  on 
several  variables  can  achieve  higher  accuracy  when  the  data  variables  are 
independent  of  each  other  than  when  they  are  redundant  and  correlated. 
Redundancy  among  data  cues  decreases  accuracy  as  it  increases  estimator 
confidence  (Tversky  and  Kahneman,  1974). 

Relying  on  highly  correlated  cues  seems  to  be  a  widespread  problem 
in  Soviet  Navy  analysis.  We  have  already  referred  to  the  tendency  of 
estimators  to  rely  heavily  on  a  particular  set  of  cues,  e.g.,  Soviet 
“hardware"  construction.  Such  reliance  is  necessary,  to  some  degree, 
because  of  the  perception  and  coding  of  any  set  of  cues  (hardware, 
software,  crisis  behavior,  etc.)  requires  specialized  data  gathering  and 
recording,  interpretation  and  analytic  expertise,  and  so  on.  The 
advantage  of  this  specialization  is  that  the  estimator  gains  a  firm 
understanding  of  the  meaning  of  the  data  set,  and  of  its  strengths  4i»d 
weaknesses.  The  danger  of  the  specialization  is  that  the  estimator  is 
likely  to  develop  a  great  degree  of  confidence  in  judgments  which  rest  on 
highly  correlated  and  redundant  data  cues.  That  is,  data  m\  various 
dimensions  of  Soviet  naval  construction,  for  aa&F-pie,  are  likely  to  be 
highly  correlated  and  consistent  (e.g.,  they  may  be  largely  determined  by 
economic  f  asters),  and  tha  analyst  will  tend  to  give  these  cues  equal 
weights  and  u§e  them  all  in  making  predictions.  This  confidence  in 
prediction  is  inappropriate,  however*  since  the  use  of  independently 
generated  data  sets  w^utd  lead  to  nore  accurate  predictions  (e.g.,  if 
^hardware"  factors  resting  en  a  single  generating  factor  such  ns  economies, 
were  integrated  with  crisis  behavior  resting  on  a  generating  factor  such 
as  diplomacy). 

Analyses  fake  two  najor  steps  to  offset  this  shortcoming  *  First* 
they  often  g§  outside  their  specialities  end  examine  Independent  data  sets 
( i • e » *  the  specialist  In  crises  behavior  will  consider  eonstrncti&n 
patterns).  This  can  (end  does)  lead  to  accusations  that  the  interloper  la 
Insensitive  to  the  nuances  sf  data  outside  his  speciality.  It  can  also 
lead  to  the  following  judgment  process:  a  tentative  hypothesis  la  formed 
hosed  on  one's  own  speciality,  and  then  independent  data  sets  are 
consulted  fur  confirming  evidence,  the  ahortca®in|a  of  this  process  are 
discussed  later  In  more  detail;  the  major  problem  being  that  the 
independent  data  Have  not  been  appropriately  integrated. 
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The  second  step  naval  analysts  take  to  offset  the  limitations  of 
specialization  is  to  exchange  work  and  to  comment  on  each  other's  data, 
methods,  end  conclusions.  This  exchange  seems  exceptionally  high  for  a 
field  of  intelligence  (which  is  often  characterized  by  tight 
corapartmentat ion)  and  seems  to  produce  a  remarkable  level  of  technical 
sophistication  among  naval  analysts.  The  shortcoming  of  this  step  is  that 
much  of  the  exchange  focuses  on  conclusions  rather  than  on  methods  and 
data.  Sven  here,  however,  there  is  a  high  level  of  sophistication;  naval 
analysts  are  not  unwilling  to  undertake  a  complete  replication  of 
another's  analysis  and  to  announce  contrary  findings  as  a  result  (e.g., 
McConnell,  SRI*  612-13;  and  Weinland,  SNP:  547ff). 

(1  do  not  mean  to  suggest  the  sophistication  implied  in  the  above 
is  unique  to  naval  intelligence.  In  part,  this  observation  is  due  to  the 
biased  sample  of  estimates  examined.  Most  of  the  authors  and  all  of  the 
editors  of  these  estimates  have  close  ties  or  direct  affiliations  to  the 
Center  for  Naval  Analysis  or  to  Dalhousie  University's  Centre  for  Foreign 
Policy  Studies.  These  two  institutions  in  turn  are  closely  connected 
through  personal  and  semi-official  ties,  leading  to  a  close-knit  community 
of  analysts,  who  have  frequent  and  strong  disagreements,  and  who  undertake 
careful  and  scholarly  debates.  This  situation  and  process  are  undoubtedly 
the  best  antidotes  for  overconfidence  in  improperly  weighted  data,  as  well 
as  many  of  the  other  biases  discussed  here.) 

A  simple  step  which  analysts  should  take  but  rarely  do,  is  to 
estimate  data  set  correlations,  either  mathematically  in  the  case  of 
quantitative  data  and  data  that  can  be  scaled,  ranked,  or  rated;  or 
impressionistically  for  qualitative  data.  These  correlations  offer  an 
index  of  the  redundancy  in  the  data  sets,  and  provide  a  signal  that 
excessive  confidence  in  predictions  may  be  inappropriate*  {There  are 
problems  with  itapeessionistie  correlation  estimation  that  are  discussed 
later.) 

For  example,  ship  days  in  a  rejion,  port  visits,  number  of  ships 
in  region,  transits  through  straits,  support  ship  days,  are  date  sets 
related  to  ‘’showing  the  flag"  and  naval  diplomacy.  These  variables  often 
tend  to  be  correlated  (e.g  ,  Weinland,  NPSP) ,  For  example,  the  pattern  of 
correlations  in  Table  4,1  shows  that,  for  'the  Indian  Ocean,  the  three  data 
sets  ara  highly  correlated  (and  hence  redundant);  port  visit  length  and 
nuebor  *se  redundant,  and  the  ware  total  ship  days  the  fewer  and  sheerer 
the  port  visits,  half  of  the  twelve  variable  pairs  in  Petersen's  Table 
are  statistically  correlated. 

This  should  net  be  taken  to  suggest  that  Petersen  errs  in 
repotting  etreeiated  data  sets,  only  that  an  explicit  awareness  af 
redundancy  would  help  offset  inappropriate  data  weightings*  Fur  example 
Petersen  writes  (Oisnuk.es  and  McConnell,  l§?9:  91.)  that 

.  *  ,  even  though  *  *  *  Indian  3t$eau  deplsy»§nts  (at 
,  measured  in  ship  days)  have  been  consistent ly  smaller  than 
those  to  the  Mediterranean,  the  effort  devoted  fa  d4pl««at4e 
visits  •  »  .  has ,  Just  as  consistently,  been  proper t lunate 1 y 
Mj|foer*  The  relative  intensity  of  the  Indian  ftgeau  effort 
*  *  .  would  appear  to  ea*f $,<?«  eh#  prowinanee  of  political 
Concerns  la  the  Indian  Ocean  squadron's  mission  structure. 

This  cbscTvati>a  is  not  consistent  With  Petef sea's  data,  which  Show  that 
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the  more  total  ship  days  spent  by  the  Soviet  naval  squadron  in  the  Indian 
Ocean,  the  fewer  the  diplomatic  port  visits  it  made  and  the  shorter  these 
visits  were.  As  the  Soviet  Navy  spends  more  time  and  effort  maintaining  a 
presence  in  the  Indian  Ocean,  it  spends  less  time  and  effort  on  diplomatic 
missions.  In  the  other  three  oceans,  and  overall,  Soviet  total  ship  days 
are  positively  related  to  port  visits. 

fit  is  interesting  that  this  pattern  is  unique  to  the  Indian 
Ocean,  although  Petersen  implies  that  similar  patterns  are  observed  in  the 
Atantic,  the  Indian  Ocean,  and  the  Mediterranean.  In  the  Atlantic,  more 
Soviet  ship  days  are  positively  related  to  longer  port  visits.  In  the 
Mediterranean  greater  total  ship  days  arc  related  to  shorter  port  visits, 
but  total  ship  days  has  a  weak  positive  relation  to  number  of  port  visits. 
Across  all  oceans,  there  is  a  strong  negative  relationship  (r  a  —.74) 
between  total  ship  days  and  ship  days  in  port,  and  a  weak  positive 
relation  between  number  of  visits  ind  total  ship  days  (r  *=  .49).] 

Cue  variability.  Cues  which  vary  more  tend  to  be  weighted  more, 
relative  to  less  variable  cues.  Similarly,  an  increase  in  the  variance,  in 
a  salient  cue  tends  to  produce  a  heavier  weighting  of  that  cue.  This 
increased  weighting  of  the  cue  may  persist  even  in  subsets  of  data  for 
which  the  v  ie  was  not  varying  in  any  unusual  way.  Cue  variation  is  an 
excellent  h-cis  for  making  differential  predictions,  but  if  carried  over 
to  subsets  which  no  such  variation  is  present,  constitutes  a  serious 
bias. 

There  is  a  strong  tendency  for  ’'aval  analysts  to  emphasize 
out-of-area  deployments  by  the  Soviet  Navy  (e.g.,  Petersen  in  Dismuke  and 
McConnell,  1979;  Murphy,  NPSP :  ch.  6)  as  evidence  of  Soviet  naval 
diplomacy  (e.g.,  icConnell  and  Dismukes,  1979;  Dismukes  and  McConnell, 
1979).  Between  1964,  when  this  forward  deployment  began,  and  1974  these 
out-of-area  ship  days  increased  more  lhan  3.5  times  (from  13,758  to  50,700 
ship  days;  Petersen  in  Dismukes  and  McConnell,  1979:  92).  Since  1974, 
however,  the  total  number  of  out-of-area  ship  days  worldwide  has  remained 
constant  and  the  total  in  each  of  the  four  ocean  areas  (Atlantic,  Pacific, 
Indian,  Mediterranean)  has  also  stayed  roughly  constant  (Murphy,  NPSP : 
127-134).  This  cue  is  still  highly  salient  and  while  it  demonstrated  high 
variability  from  1964-1974,  the  lack  of  variability  since  1974  has  not 
reduced  the  weight  given  this  cue  by  many  naval  analysts. 

Number  of  cues.  Increasing  the  number  of  cues  available  to  people 
tends  to  increase  their  confidence  in  the  accuracy  of  their  predictions, 
with  no  corresponding  increase  in  actual  accuracy.  For  example,  Oskamp 
(1965)  had  32  clinical  judges  .ead  background  inf  -rmation  on  a 
psychological  patient.  The  information  was  divided  into  four  parts  and, 
after  reading  each  part,  the  judges  answered  25  questions  about  the 
attitudes  and  beliefs  of  the  patient.  They  also  gave  a  confidence  rating 
with  each  a:  swer.  The  correct  answers  were  known  to  the  experimenter.  As 
the  amount  of  inforwatlon  on  the  patient  increased,  accuracy  or  the 
questions  remained  constant,  while  confidence  increased  dramatically  and 
out  of  all  proportion  to  accuracy. 

We  have  no  means  to  judge  Che  confidence  of  naval  analysts  in 
their  estimates,  short  of  a  content  analysis  of  their  use  of  “probably “ 
and  “maybe”  versus  their  use  of  “certainly”  and  “surely,”  a  questionable 
technique  at  beat.  We  can  observe,  however,  that  naval  analysts  in  our 
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sample  use  a  very  large  number  of  variables  in  making  their  judgments.  As 
we  noted  in  Chapter  3,  the  minimum  error  in  their  estimates  on  several 
crucial  issues  is  large  (i.e.,  wide  disagreements  imply  that  some  of  the 
analysts  must  be  wrong,  and,  of  course,  they  may  all  be  wrong).  Analyst 
confidence*  in  judgments  should  not  be  based  on  the  amount  of  information 
related  in  the  estimate,  but  on  the  probative  value  of  the  information 
used.  Neither  should  an  estimate  consumer  take  the  amount  of  information 
to  be  an  index  of  the  estimate's  accuracy. 

Cue-response  compatibility.  The  greater  the  compatibility  between 
a  cue  and  the  required  reponse  (e.g.,  estimate  or  prediction),  the  more 
important  that  cue  is  like?/  to  be  in  determining  the  response  (see,  e  g., 
Hamilton  and  Fallot,  1974).  Cues  which  require  complex  transformations  to 
be  useful  will  be  less  heavily  weighted  than  cues  which  are  readily 
related  to  the  estimation  response.  This  tendency  reinforces  the 
operation  of  representativeness  heuristic,  since  cues  will  be  weighted 
heavily  which  are  representative  of  the  estimation  response.  For  example, 
if  the  estimation  required  is  to  predict  the  future  number  and  tactics  of 
Soviet  attack  submarines,  the  cues  that  will  be  most  heavily  weighted  will 
tend  to  be  those  most  compatible  and  representative:  data  on  present  and 
past  attack  submarine  numbers  and  tactics.  In  general,  this  heuristic 
will  vide  adequate,  but  may  lead  to  significant  biases  if  cues  which 
are  unrepresentative  in  character  are  also  important  for  the  estimation 
response.  For  example,  space  surveillance  of  submarines  and  surface 
targets,  and  real-time  retargeting  of  ballistic  missiles  may  reduce  the 
requirement  for  a  large  fleet  of  attack  submarines;  their  missions  may  be 
taken  over  by  aircraft  and  land-based  systems.  Alternatively,  if  SNA 
aircraft  were  to  become  more  vulnerable,  more  attack  submarines  might  be 
required.  Neither  the  space  surveillance  cue  nor  the  SNA  cue  are  as 
compatible  with  Che  estimation  response  as  the  more  representative 
submarine  cues.  There  may  be  the  danger  of  underweighting  the  former, 
although  their  predictive  value  may  be  high. 

Cue  salience  and  vividness.  Perhaps  the  most  important 
determinants  of  cues'  weights  are  the  vividness  and  salience  of  the  data 
they  contain.  Repeatedly  psychologists  have  found  that  vivid,  concrete 
information  is  weighted  more  heavily  than  abstract,  statistical  data 
(eg.,  a  single  case  study  is  more  influential  than  a  statistical  summary 
of  a  large  series  of  cases).  This  tendency  means  that  some  types  of  data 
are  almost  never  weighted  heavily,  e.g.,  nonevents  and  nonoeeurrences.  It 
also  leads  to  the  over-use  of  "representative"  rather  than  statistical 
samples,  the  reliance  on  too-small  samples,  and  the  use  or  inappropriate 
"relevance"  criteria  for  data  weighting  (Uar-Hillei,  5978;  Tver  sky  and 
Kahneman,  1974).  These  problems  all  contribute  to  overweighting  of  data 
which  are  loss  reliable  than  other  data  that  could  be  utilised. 

Psychologists  have  only  recently  become  aware  of  the  degree  to 
which  salience  influences  the  weight  given  data  by  judges  and  estimators 
(see  Hamilton,  1979  and  Taylor  and  Piske,  1978,  for  reviews  of  the 
psychological  literature).  Data  are  salient  which  are  distinctive, 
physical:/  prominent,  easily  perceived  or  available,  highly  visible, 
novel,  unique,  singular  or  unfamiliar.  None  of  these  features  of  the  data 
by  themselves  should  lead  the  estimator  to  give  them  more  weight  than 
other,  pallid  evidence,  yet  there  are  strong  tendencies  to  do  so.  Salient 
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data  is  given  more  attention  (this  was  discussed  above  under  "perceiving 
data"),  salient  events  produce  more  extreme  judgments,  salient  factors  may 
be  credited  with  playing  a  special  or  causal  role  in  events,  and 
estimators  tend  to  make  confident  and  extreme  inferences  on  the  basis  of 
salient  data  (Hamilton,  1979:  59-64). 

Nonevents .  The  use  of  nonoccurrence  and  nonovent  data  is 
uncommon,  perhaps  for  two  reasons.  First,  there  is  the  tendency  for 
behavior  to  "engulf"  the  perceiver,  as  Heider  (1958)  suggested,  so  that 
nonbehavior  is  just  not  as  easily  perceived,  or  categorized  as  behavior, 
and  is  thus  not.  available  to  the  estimator.  Second  to  use  nonbehaviors 
and  nonoccurrences  as  inferential  data,  the  observer  must  have  a  mental 
theory  relating  event  A  with  event  B.  That  is,  only  if  event  A  is  likely 
to  occur  in  conjunction  with  critical  event  B  (e.g.,  mobilizations,  A 
prior  to  attacks,  B),  can  A  by  its  absence,  provide  diagnostic  data  as  to 
B.  However,  people  are  not  highly  skilled  at  detecting  covariations,  as 
will  be  reviewed  later,  they  tend  to  estimate  them  on  the  basis  of 
positive  instances  only,  thus  they  will  tend  not  to  be  aware  of  the 
inferential  utility  of  nonoccurrences,  and  will  not  weight  them  enough. 
Nonevents  lack  salience  because  they  fail  to  fit  into  the  estimator's 
mental  theory  of  the  covariation  situation. 

There  have  been  several  Soviet  nonevents,  however,  which  have 
prompted  considerable  disoussion  among  naval  analysts,  especially  after 
the  nonevents  became  events.  Three  examples  are  aircraft  carriers, 
forward,  deployment,  and  foreign  bases.  Each  of  these  aspects  of  the 
Soviet  Navy  received  some  attention  when  they  were  nonevents,  but  received 
much  more  attention  when  the  Soviets  showed  signs  of  changing  their 
behaviors,  i.e.,  by  building  their  versions  of  carriers,  by  keeping  ships 
out  of  home  waters,  and  by  seeking  and  building  bases  abroad.  It  is 
difficult  to  judge  the  degree  that  naval  analysts  as  a  group  neglect 
nonevents;  some  weight  nonevents  very  heavily.  For  example,  Herrick 
(1968)  saw  the  lack  of  Soviet  aircraft  carriers  in  the  late  1960s  as  a 
clear  sign  that  Soviet  naval  doctrine  was  highly  defensive,  with  no 
presumptions  or  aspirations  of  sea  control.  On  the  other  hand,  the  decade 
of  Soviet  Navy  nonsupport  for  North  Vietnam  during  its  war  with  the  United 
States  (including  the  U.S.  Navy)  has  prompted  relatively  little  analysis 
and  mostly  puzzlement  among  naval  analysts. 

Case  cues  versus  base-rate  cues.  One  implication  of  the 
"  represent a  t  Tvcness  "  "hour  i  s  tie  ~( r  e  Vi  ewef  above)  is  that  estimators  may 
weight  data  on  specific  cases  heavily  while  paying  far  less  attention  to 
abstract  statistics  wnic  cover  many  cases  (Bar-Hillel,  1978,  1979; 
Kahneoan  and  Tversky,  1975;  Nisbett  and  Ross,  1980;  Ross,  1977;  Tversky 
and  Kahneman,  1974). 

For  example,  in  outlining  the  "rules  of  the  game"  followed  by  the 
Soviet  Navy  in  peacetime,  Dismukes  and  McConnell  (1979:  ch.  7)  weighted 
the  Middle  East  crises  of  1967,  1970,  and  1973,  quite  heavily.  Less 
heavily  weighted  it  seems  wore  the  1968  and  1969  crises  off  Korean  waters, 
and  the  1972  noncrisis  in  the  South  China  Sea.  In  the  latter  cases  the 
U.S.  Navy  posed  a  direct  threat  to  Soviet  clients  and  allies,  but  produced 
little  or  no  Soviet  naval  confrontation.  The  former  cases  of  naval 
confrontation  (on  behalf  of  much  more  tenuous  Soviet  clients)  seem  to  be 
the  primary  basis  for  the  "rules"  that  Dismukes  and  McConnell  suggest  the 
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Soviet  Navy  observes.  They  classify  the  latter  crises  as  "Support  of  a 
Client  against  Western  Great  Powers"  (p.  260)  and  the  former  as  "Support 
of  a  Client  Against  a  Western  Client"  (p.  267).  However,  their  "rules" 
clearly  place  the  Middle  Eastern  crises  as  cases  of  superpower 
confrontation  as  well  (e.g.,  ch.  5,  p.  288-89),  while  the  Asian  crises  are 
not  considered  superpower  confrontations  (e.g.,  ch.  5).  If  Dismuk.es  and 
McConnelJ  selected  as  most  representative  those  crises  which  are 
apparently  confrontational  (but  which  might  lack  much  incentive  or 
motivation  for  confrontat  on),  while  tending  to  weight  less  heavily  crises 
where  no  confrontation  occurred  (but  where  the  incentives  and  motivations 
to  counter  a  Western  threat  or  attack  on  a  client  or  ally  was  much 
greater),  as  we  are  suggesting,  then  their  "rules  of  the  game"  will  tend 
to  suggest  the  Soviets  are  more  likely  to  risk  a  clash  with  Western  navies 
than  is  implied  by  the  total  data  base  on  Soviet  Navy  crisis  behavior. 

It  is  impossible  to  assess  quantitatively  whether  naval  analysts 
have  overweighted  specific  cases  and  underweighted  the  total  data  base  on 
Soviet  crises.  Nor  is  it  possible  to  determine  if  it  is  better  to  weight 
heavily  the  worst  cases  (i.e.,  those  most  suggestive  of  U.S .-USSR  naval 
conflict)  which  p^se  the  most  serious  threat,  or  to  weigh  all  crises  more 
equally  and  thus  determine  the  more  probable  nature  of  Soviet  crisis 
behavior.  Since  there  are  significant  dangers  in  either  course  of  action 
(e.g.,  see  Wohlstetter,  1979,  on  the  dangers  of  underestimation  of 
threats,  and  Stech,  1980a,  on  the  dangers  of  overestimation),  perhaps 
naval  analysis  would  be  better  served  by  more  explicit  attention  to  the 
role  of  the  representativeness  heuristic  and  the  tendency  to  underweight 
base  rate,  and  an  explicit  assessment  of  both  the  worst  (but  unlikely) 
cases  and  the  more  likely  (and  less  serious)  base  rates. 

Illusory  correlation.  One  important  consequence  of  these  salience 
effects  is  "illusory  correlation,"  an  overestimation  of  the  frequency  of 
co-occurrence  of  distinctive  stimuli  (Chapman,  1967;  Chapman  and  Chapman, 
1967;  Hamilton  and  Gifford,  1976).  Salient  and  distinctive  events  may 
seem  to  co-occur  simply  because  they  are  both  distinctive,  rather  than 
because  they  are  actually  correlated.  For  example,  both  laymen  and 
psychologically  sophisticated  clinicians  believed  that  psychiatric 
patients  who  exaggerated  or  distorted  the  eyes  in  drawing  were  likely  to 
be  paranoid;  that  those  who  umphasize  the  mouth  or  drew  feminine  or 
childlike  figures  were  dependent;  that  those  who  drew  muscular,  broad 
shouldered,  manly  figures  were  impotent,  and  so  forth.  In  fact,  none  of 
the  "symptoms"  noted  in  the  drawings  has  any  valid  clinical  correlation 
with  the  disorders  mentioned.  The  widely  perceived  correlations  were 
empirically  invalid. 

In  researching  this  phenomenon,  Hamilton  and  Gifford  (1976)  found 
that  uncommon  group  raumbers  (e.g.,  minority  members)  tend  to  bo  associated 
with  uncommon  behavior,  even  when  no  empirical  correlation  was  present. 
Salient  stimuli  tended  to  bo  psychologically  associated  and  people 
overestimated  the  frequency  of  their  co-occurrence  when  no  correlation 
existed.  Data  salience  may  generate  the  perception  of  illusory 
relationships. 

The  illusory  correlation  bias  would  be  less  troublesome  if  people 
were  able  to  efficiently  evaluate  the  strength  of  a  correlation.  That  is, 
while  .an  estimator  might  mistakenly  perceive  a  relationship  between  two 
highly  salient  events,  no  damage  would  be  done  if  the  estimator  could 
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accurately  and  quickly  assess  the  strength  of  the  relationship.  Finding  a 
low  correlation,  the  estimator  could  modify  his/her  perception. 
Unfortunately,  the  estimation  of  correlation  is  a  highly  biased  and 
difficult  task,  as  is  discussed  below. 

Furthermore,  people  do  not  seem  to  be  able  to  efficiently  check 
their  hypotheses  against  the  available  data,  and  are  able  to  find  support 
for  wrong  hypotheses  in  almost  ;  ny  set  of  data.  This  weak  hypothesis 
testing  ability,  also  discussed  in  detail  below,  will  tend  to  allow 
perceptions  of  illusory  correlations  to  persist  despite  data  which  would 
invalidate  them. 

The  hypothesis  that  the  Soviet  Navy  knowingly  supported  the  Libyan 
coup,  which  has  been  discussed  above  and  in  chapter  3,  seems  to  be  an 
illusory  relationship  prompted  by  the  proximity  of  two  highly  salient 
events,  a  Soviet  naval  exercise  and  the  successful  coup.  It  is  also 
apparently  quite  resistant  to  contradictory  and  inconsistent  evidence. 

More  generally,  the  perception  among  Western  analysts  that  the 
Soviets  actively  foster  and  support  coup  attempts  by  socialist, 
auti-Western  factions  seems  just  as  strong  as  the  communist  perception 
that  the  United  States  sponsors  coups  by  rightwing,  anti-communist 
factions.  While  this  perception  may  be  true  in  specific  instances  (e.g. 
Afghanistan,  1978;  Iran,  1953)  it  is  probably  an  illusory  correlation  in 
general.  The  glee  and  support  with  which  both  sides  greet  coups  they 
favor  does  hot  imply,  although  it  is  taken  to  by  the  other  side, 
complicity  before  the  fact. 

Vivid  cues.  Vivid,  concrete  information,  as  is  commonly  found  in 
case  studies,  tends  to  be  used  to  a  greater  extent  and  is  given  greater 
weight  than  statistical  or  abstract  data  (Kahneman  and  Tversky,  1973; 
Nisbett,  Borgida,  Crandall,  and  Reed,  1976;  Nisbett  and  Ross,  1980).  This 
bias  is  dangerous  because  it  amounts  to  weighting  a  sample  of  one  heavily 
and  a  sample  of  many  no„  at  all  or  only  lightly.  Only  in  the  rare  event 
that  the  case  study  is  a  perfect  predictor  of  the  entity  being  estimated 
Bhould  case  data  be  utilized  to  the  neglect  of  data  based  on  many  cases. 

Several  characteristics  of  data  can  make  them  more  vivid ,  none  of 
which  add  to  the  diagnostic,  predictive,  or  probative  value  of  the  data. 
Nisbett  and  Ross  (1980:  45-51)  note  three:  emotional  interest, 
concreteness  and  imagery  provocativeness,  and  spacial,  temporal  or  sensory 
proximity.  Taylor  and  Fiske  (1978:  259-51)  note  brightness,  motion 
complexity,  and  novelty. 

The  emotional  impact  of  data  often  influence  estimations  based  on 
them.  For  example,  Walster  (1966)  found  people  attribute  more 
responsibility  to  a  person  involved  in  a  serious  accident  than  in  a 
trivial  one,  although  behavior  was  identical  in  both  cases. 

Case  studies  of  U.S. -Soviet  naval  confrontations  that  almost  led 
to  conflict  are  likely  to  be  far  more  emotion-laden  than  cases  with 
insignificant  outcomes.  In  both  instances  the  naval  behaviors  may  be 
quite  similar,  and  the  different  outcomes  the  result;  of  diplomatic 
factors,  client  behaviors,  or  other  aspects  of  the  nonnaval  context. 

Concreteness  refers  to  the  level  of  detail  and  specific 
Information  about  actors,  actions,  and  contexts.  Greater  detail  aids  in 
the  "imuginabillty,”  i.e.,  the  tendency  to  prompt  sensory  imuges.  Events 
may  be  highly  concrete,  while  statistical  data  are  far  less  so,  and 
nonevents  (see  above)  have  virtually  no  concreteness  at  all. 


Information  proximity  increases  its  vividness.  Firsthand 
observation  is  more  vivid  and  weighted  more  than  data  from  second-  or 
thirdhand  sources.  Events  which  are  'close  to  home'  are  more  vivid  than 
more  peripheral  occurrences.  Recent  events  are  more  vivid  than  the 
'distant  past.' 

There  are  several  psychological  reasons  why  vivid  data  receive 
more  weight,  none  of  which  have  anything  to  do  with  such  data  being  more 
diagnostic  or  predictive.  Nisbett  and  Ross  (1980:  51-59)  discuss  four: 
memorability,  redundancy,  recruitment,  and  rehearsal. 

Concrete  and  imaginable  data  are  more  easily  stored  and  recalled 
from  memory  than  abstract  information.  Imagery  in  particular  seems  to 
accentuate  memorability.  More  memorable  data  are  more  available  for 
recall,  which  may  facilitate  the  operation  of  the  availability  heuristic. 
That  is,  more  vivid  events  should  be  recalled  more  easily  and  judged  as 
more  frequent  than  less  vivid  events.  This  is  what  has  been  found  in 
studies  of  the  perceived  frequencies  of  causes  oc  death  and  lethal  events 
(Combs  and  Slovic,  1978;  Lichtenstein,  Slovic,  Fischhoff,  Layman  and 
Combs,  1978).  Causes  of  death  which  were  easy  to  imagine,  easy  to 
remember,  well  publicized,  or  contained  features  which  increased  their 
salience  were  overestimated  (i.e.,  perceived  to  cause  more  deaths  than 
they  actually  did).  Less  vivid  causes  were  underestimated.  Because  the 
factors  increasing  vividness  of  causes  were  unrelated  to  the  actual 
l-ethality  of  the  causes,  the  impact  of  vividness  on  data  weights  was  to 
increase  estimation  errors. 

Carroll  (1978)  has  shown  that  imagining  a  specific  case  in  detail 
tends  to  increase  the  perceived  likelihood  of  the  case  and  may  make  the 
specific  case  seem  more  likely  than  the  class  from  which  the  case  was 
drawn,  a  mathematical  impossibility.  That  is,  imagining  an  automobile 
accident  on  a  nearby  street  .orner  tends  to  increase  the  estimated 
likelihood  of  the  accident,  and  may  increase  that  likelihood  beyond  the 
perceived  probability  of  an  accident  on  the  entire  street. 

Vividness  implies  greater  detail  and  hence  more  information. 
While  more  facts  may  be  presented  in  a  vivid,  concrete  case  study  than  in 
a  statistical  a<  fact,  many  of  the  facts  in  the  former  are  highly 
redundant  and  add  little  or  nothing  to  the  estimation  or  prediction  task. 
Such  redundancy,  however,  facilitates  encoding  and  recall  from  memory. 
Consequently,  redundant  information  may  be  mors  available  from  memory  than 
more  relevant  facts,  but  far  less  useful  for  estimation  and  prediction. 

Because  vivid,  concrete  information  is  stored  in  memory  on  a 
multitude  of  dimensions  (due  to  its  rich  detail),  and  accessible  from 
memory  via  many  pathways,  on  recall  it  is  more  likely  to  recruit  mental 
theories  or  schemas,  as  well  as  specific  details.  These  mental  theories 
themselves  are  linked  to  additional  images  and  stored  episodes  which  can 
be  readily  recalled  to  ruinforce  the  specific  details  of  the  vivid  case. 
These  theories  may  provide  u  convenient  "explanation”  of  the  case,  further 
veinforcing  the  conception  of  the  case  as  a  valid,  confirming  instance  of 
the  theory.  Abstract  information  is  less  likely  to  recruit  an  organized 
mental  theory,  or  fit  so  readily  into  an  explanatory  framework. 

Vivid  data  are  likely  to  remain  in  thought  for  longer  periods 
after  it  is  received.  Tesser  (  1978)  has  found  that  the  longer  a  person 
thinks  about  a  case,  the  more  extreme  the  evaluation  of  the  case  becomes 
(see  Taylor  and  Fiskc,  1978:  265,  for  additional  evidence).  Thus,  vivid 
cases  by  remaining  in  thought  longer,  will  tend  to  prompt  more  extreme 
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evaluations.  Nisbett  and  Rosa  (1980:  35)  suggest  people  may  wolght  vivid 
information  more  heavily  simply  because  they  find  themselves  thinking  of 
it  more:  'if  it  weren't  important,  why  would  I  keep  thinking  about  it?' 
To  the  extent  that  estimators  and  analysts  assume  that  what  occupies  their 
thoughts  must  be  important  for  their  estimates  and  predictions,  they  will 
be  vulnerable  to  an  overweighting  of  vivid  information. 

The  impacts  of  vivid  cases  on  analysts  of  Soviet  peacetime  naval 
intentions  are  present  throughout  the  sampled  estimates.  For  example, 
analytic  concern  with  the  peacetime  role  of  the  Soviet  Navy  can  be  dated 
fairly  precisely;  prior  to  June  1967  there  was  little  concern  over  the 
peacetime  functions  of  the  Soviet  Navy.  After  the  Six-Day  War,  and  the 
Soviet  Navy's  involvement  in  the  crisis,  analytic  concern  developed  and 
flourished.  In  fact,  the  sinking  in  that  war  of  an  Israeli  destroyer  by  a 
Soviet  antiship  cruise  missile  fired  from  aw  Egyptian  patrol  craft  can  be 
viewed  as  the  single,  vivid  event  which  jarred  Western  analysts  into 
reconsidering  the  th»*  ‘at  posed  by  the  Soviet  Navy  in  war  and  peace,  and 
the  threat  of  Soviet-*. .  ilpped  client  states. 

(A  'nonevent*  of  a  similar  nature  makes  an  interesting  coraparison. 
In  the  1973  October  War,  Egyptian  and  Syrian  craft  repeatedly  fired 
Soviet-supplied  antiship  cruise  missiles  at  Israeli  vessels  without  as 
much  as  a  serious  hit,  much  less  any  sinkings.  Israeli  missile  boats  sank 
19  Arab  vessels,  including  ten  Soviet-supplied  Arab  missile  boats,  without 
a  single  Israeli  loss  (Safran,  1978:  166).  The  Soviet-built  weapons 
produced  no  positive  effects  and  this  nonevent,  lacking  the  vividness  and 
emotional  sa.Uency  of  the  1967  sinking,  largely  escaped  attention,  at 
least  in  the  West.  On  the  other  hand,  the  success  in  1973  of  Soviet-built 
anti-tank  missiles  against  Israeli  armor,  and  of  Soviet  supplied 
surface-to-air  missiles  against  Israeli  jets,  two  extremely  vivid  event 
provoked  even  more  Western  comment  than  the  1967  sinking.) 

Taylor  and  Fiske  (1978:  251)  provide  a  cogent  summary  of  the 
psychological  difficulties  of  weighting  data; 

.  .  .  Instead  of  employing  base  rate  •  .  .  information 
logically,  people  are  often  more  influenced  by  a  single 
colorful  piece  of  case  history  evidence  .  .  .  Instead  of 
using  correlational  evidence  appropriately,  subjects' 
subjective  estimates  of  correlation  magnitude  are  often 
determined  largely  by  positive  instances  .  .  .  Instead  of 
reviewing  all  the  evidence  that  bears  upon  a  particular 
problem,  people  frequently  use  the  information  which  is  most 
salient  or  available  to  them,  that  is,  that  which  is  most 
easily ‘brought  to  mind. 

Having  opened  this  section  with  Aschcr's  observations  on  the  centrality  of 
core  assumptions  to  the  accuracy  of  forecasts,  it  is  fitting  to  close  with 
his  remarks  (1978:  160)  on  a  major  source  of  consistent  inaccuracy  in 
forecasting: 


.  .  .  forecasters  believe  their  assumptions  about  the  future 
already  Incorporate  all  the  data  that  is  pertinent  to  known 
trends.  It  is  another  cose  of  forecasters  being  locked  into 
a  scientific  outlook,  which  acknowledges  only  information 
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relating  to  the  phenomena  studied  rather  than  information  on 

the  behavior  of  the  experts  studying  them. 

Characterizing  Data 

As  data  are  perceived  and  weighted,  they  are  characterized 
perceiving  involves  an  act  of  categorization.  That  is,  people  attach  a 
description  to  an  individual  piece  of  information  to  help  code  it  for 
memory  and  later  inferential  work  (e.g.»  such  a  categorization  might  be 
Soviet  "tattletale"  shadowing  of  li.S.  ships).  They  characterize  data 
aggregates  or  samples  (e.g.,  Soviet  naval  behavior  in  the. 1973  Middle  Hast 
crisis),  i.e.,  grouping  facts  together.  They  generalize  from  samples  to 
make  inferences  about  a  population  (e.g.,  Soviet  naval  crisis  behavior). 
Each  of  these  data  characterizing  tasks  is  a  necessary  step  in  inference. 
The  first  two  steps  are  basically  descriptive  while  the  last  is 
inferential,  bur  all  steps  in  categorizing  or  characterizing  data  involves 
some  inference  —  the  data  n«ver  ’speak  for  themselves 1  even  in  so  simple 
a  matter  as  description;  some  inference  about  categories  is  also 
necessary  * 

Perhaps  the  oldest  idea  in  psychology  and  epistemology  is  that 
mental  theories  (or  preconceptions)  influence  Che  coding  and 
interpretation  of  data.  One  of  the  commonest  and  most  dangerous 
misconceptions  people  have  is  the  assumption  that  they  approach  data 
without  preconceived  notions,  without  theories.  Washerman  (196U)  labeled 
this  tendency  in  intelligence  analysis  "naive  realism."  the  belief  that 
knowledge  and  intelligence  consists  of  "env  irnishec"  facts  which  allow 
only  one  interpretation.  Hilsman's  (1956)  analysis  of  strategic 
intelligence  found  the  widespread  notion  that  knowledge  was  “facts 
divorced  from  thought  or  interpretation."  There  are  a  variety  of  damaging 
consequences  of  this  naive  faith  in  “plain  facts"  (see  bteeh,  1979:  54-Sb 
for  an  analysis  of  these  consequences  and  intelligence  failures),  one  of 
which  is  the  vulnerability  of  believers  to  their  own  and  others’ 
preconceptions  and  mental  theories.  Those  who  believe  the  “caw"  facts 
speak  for  themselves  will  tend  not  to  check  carefully  how  those  facts  were 
categorized  or  interpreted.  As  we  will  demonstrate  in  this  section,  data 
can  be  characterized  improperly,  or  organised  into  categories  that  make 
subsequent  inferences  difficult  to  make. 

Problems  caused  by  characterisations.  Some  of  tie  difficulties 
that  resuIlTTrom^^  demonstrated  with  Figure  4.2. 

Suppose  there  is  a  strong  positive  relationship  between  Soviet  diplomatic 
interests  in  the  Third  World  and  Soviet  willingness  to  risk  a  superpower 
naval  confrontation  in  crises  when  those  interests  are  threatened  (as  has 
boon  suggested  by  uaval  analysts,  e.g.,  Dismukes  and  McConnell,  1979:  eh. 
7),  The  horizontal  axis  shows  the  indicator  variable,  Soviet  interests 
increasing  from  left  to  right.  The  vertical  axis  shows  the  performance 
variable,  Soviet  rir.k-taking,  increasing  from  bottom  to  top.  The  strong 
(but  not  perfect)  relationship  between  these  cwo  variables  is  indicated  by 
the  ellipsoid  shape;  all  Soviet  behaviors  fail  inside  the  ellipse. 

Supposes  an  analyst  characterizes  all  instances  to  the  right  of  the 
vertical  line,  X,  as  “vital  interests  at  stake  “  chose  to  the  letc  as 
“nonvital,"  and  the  analyst  predicts  that  "the  Soviets  will  risk 
confrontation  when  vital  interests  are  at  stake."  The  analyst’s 
prediction  success  depends  on  the  characterization  of  the  performance 
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PERFORMANCE  DATA 

(SOVIET  WILLINGNESS  TO  RISK  superpower  confrontation) 


Figure  4.2.  Hypothetical  Relation  Between  Indicator  Data 
and  Performance  Data 


INDICATOR  DATA 

(SOVIET  INTERESTS  AT  STAKE) 


data.  If  the  criteria  is  sot  high,  say  at  line  A,  then  only  extreme 
Soviet  behavior  is  characterized  as  "risking  confrontation"  (e.g.,  when 
Soviet  ships  fire  on  U.S.  ships).  The  implication  of  this  extreme 
characterization  is  that  the  analyst  is  usually  wrong;  in  most  cases  in 
which  Soviet  interests  are  "vital “  (greater  than  X)  the  Soviets  do  not 
fire  on  i'.S.  ships  (the  area  labeled  "false  alarms"  is  much  larger  than 
the  area  1^'xied  “positive  hits").  The  analyst  faced  with  this  state  of 
affairs  might  question  the  strength  of  the  relationship  (i.e.,  the 
validity  of  the  theory),  or  may  question  the  characterization  of 
risk-taking. 

Suppose  the  analyst  redefines  risk  and  characterizes  the  Soviets 
as  “willing  to  risk  confrontation"  if  they  merely  increase  the  total 
number  of  Soviet  warships  in  the  crisis  area  (denoted  in  the  Figure  by 
line  B).  Now  the  analyst  is  always  correct  that  when  Soviet  interests 
exceed  the  X  level,  the  Soviets  wiii  move  more  ships  into  the  crisis  area 
(i.e.,  exceed  the  B  level).  Now,  however,  the  analyst  is  plagued  by 
surprises;  «.ne  Soviets  often  increase  the  number  of  warships  in  crisis 
areas  when  their  interests  are  below  the  X  level  (the  area  labeled 
surprises"  is  larger  than  the  area  in  the  ellipse  to  the  right  of  the  X 
line).  Again  the  analyst  may  question  the  validity  of  his  theory,  or  his 
charac tertzatiou. 

This  hypothetical  example  demonstrates  the  difficulty  analysts 
have  with  verbal  characterizations  of  data  when  their  theories  are  strong 
but  not  perfect.  In  the  absence  of  a  quantitative  assessment  of  the 
theory,  the  analyst  appears  as  either  an  alarmist  pessimist  (the  A  line) 
or  an  inefficient  epeitaist  (the  f?  lira),  and  in  both  cases,  wrong  more 
often  than  right.  Because  of  the  sensitivity  of  his  predictions  to  the 
characterisation  of  data,  the  analyst  may  reject  an  accurate  (but 
imprecise  theory)  and  accept  his  experiences  as  evidence  that  the  theory 
is  wrong,  when  in  fact  the  error  is  in  the  reliance  on  inaccurate  and 
inappropriate  verbal  characterizations  of  a  relationship  (the  theory)  that 
cannot  be  specified  clearly  in  verb**!  terms. 

This  example  assumed  tnut  the  analyst  is  sensitive  to  surprises 
and  false  alarms  as  well  as  to  positive  hit.;  in  assessing  the  strength  of 
the  relationship  between  the  indicator  data  and  the  performance  data.  In 
fact,  people  are  not  good  judges  of  correlation,  primarily  because  they 
attend  only  positive  hits  and  ignore  surprises  and  raise  alarms.  This 
bias  is  covered  below  under  “assessing  covariation."  The  implication  of 
this  insensitivity  is  that  the  analyst  may  retain  an  inaccurate  theory  or 
not  question  his  characterisations  of  data. 

Prototypes  and  as  categories  *  The  traditional  view  of 

categories  and  e  1  a  s  s  i  f  i cat  1  on ^ se h >  “lies  assumes  that  all  members  of  a 
category  possess  a  son  11  set  of  critical  features.  This  suggests  an 
alt-oc-noue  criterion  for  category  faeobership.  if  an  object  has  ail  the 
critical  features,  it  belongs  in  'die  category,  if  not,  it  does  not.  Such 
distinct,  necessary  and  sufficient  critical  features  are  not  eoesaon  in 
everyday  categories,  e.g.,  those  applied  to  events  and  couples  objects. 
The  example  above  demonstrates  how  everyday  categories  tend  to  be  located 
on  a  eoutiuuuo  of  sftared  family  resemblance,  Ail  Members  of  a  natural 
category  (e.g..  Soviet  risk-taking  behavior)  do  not  share  a  set  O.  singly 
necessary  .u si  jointly  sufficient  features  defining  twafcarsldp.  Instead 
the  Members  of  *  category  share  a  pattern  of  overlapping  and  crisscrossing 


similarities.  Cantor  and  Mischel  (1979)  have  reviewed  how  natural 
everyday  categories  are  used  in  the  perception  of  people.  Their  analysis 
is  also  relevant  for  the  characterization  of  complex  events,  such  as  those 
examined  by  naval  analysts. 

Fuzzy  categories.  In  contrast  to  the  traditional  view  of 
categories  as  marked  by  clear  boundaries,  psychologists  have  come  to  view 
natural  semantic  categories  as  “fuzzy  sets"  that  lack  the  classical 
all-or-none,  either-or  characteristic  (see  Cantor  and  Mischel,  1979:  8-10, 
for  the  philosophical  and  psychological  roots  of  this  evolution) .  Rather 
than  being  characterized  by  necessary  and  sufficient  features,  natural 
categories  seem  to  be  organized  around  prototypical  or  focal  stimuli; 
exemplars  that  are  the  best  examples  of  the  concept.  Less  prototypic 
members  form  a  continuum  away  from  the  more  central  prototypic  exemplars. 
All  category  members  possess  some  of  the  critical  features  of  the 
category,  enough  to  be  judged  as  members.  But  category  members  may  differ 
in  how  well  they  fit  the  abstract  concept  represented  by  the  category 
name.  That  is,  they  may  be  more  or  less  "good"  cases  of  the  prototypic 
exemplar. 

Cantor  and  Mischel  (1979)  point  out  that  a  category  continuum  is 
translated  into  linguistic  hedges:  "Soviet  ships  firing  on  U.S.  ships  are 
a  true  case  of  Soviet  risk-taking"  or  "Soviet  expansion  of  crisis  naval 
presence  may  be  taken  as  an  instance  of  risx-taking .  *'  Because 
"risk-taking"  is  an  ill-defined  concept,  membership  may  be  a  matter  of 
degree,  rather  than  of  sharp  logical  boundaries. 

Probabilistic  boundaries.  The  "fuzzy  set"  approach  suggests  that 
a  categorization  decision  is  probabilistic  in  nature.  The  hypothetical 
analyst  in  the  example  above  would  have  been  better  off  attempting  to 
determine  the  correlation  between  the  members  of  the  two  concinua  rather 
than  attempting  to  observe  clear  boundaries  between  "risk-taking"  and 
"nonrisk-taking"  behaviors-  Because  members  of  natural  categories  vary  in 
their  degree  of  membership  (prototypicality)  there  are  many  ambiguous 
borderline  cases  and  overlapping  and  fuzzy  boundaries  between  categories. 
An  explicit  treatment  of  this  probabilistic  character  is  likely  to  be  store 
realistic  than  an  absolute  pigeonholing  approach. 

The  difficulty  of  categorizing  complex  stimuli  is  suggested  by 
several  of  the  methodological  devices  developed  by  naval  analysts  to 
categorise  such  things  as  the  missions  of  the  Soviet  Wavy  (e,g  ,  Thorpe, 
NPSP,  ch»  8)  or  the  effectiveness  of  Soviet  ships  (e.g.,  Rehoe,  SMI,  eh. 
19;  Meier,  SMI,  eh.  20).  These  methodologies  assume  that  a  concept  like 
“mission"  is  difficult  to  define  and  divide  and  may  have  only  fussy 
boundaries.  Thus,  complex  methods  ate  needed  to  abstract  judgments  e£  the 
prototypic  meaning  of  such  categories  as  “the  artiship  mission"  so  that  it 
has  soon  wide  agreement  among  analysts.  Another  analytic  technique  is  the 
explication  of  taxonomies;  classification  schemes  to  organise  objects 
(o.g.,  ship  classes  and  types)  or  events  (e.g  ,  superpower  crises  versus 
local  crises). 


categories  and  memory.  Since  the  early  work  of  Bartlett  In  the 
1920s  and  T55SS ,  psychologists  have  been  aware  that  complex  events  ate 
reconstructed  In  memory  rather  than  recollected  (Norman,  |9&9).  Bartlett 
found  that  accurate  reports  vet  the  exception  when  people  attempted  to 
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recall  stories,  arguments,  or  drawings.  What  typically  occurs  In  memory 
is  a  reconstruction  from  n  general  prototype  or  "schema,"  or  an  active 
characterization,  of  the  original  data.  This  schema  depends  heavily  on 
whatever  the  person  perceives  to  be  the  Isolated,  striking,  or  salient 
details  In  the  original  data.  Consequently,  recall  of  complex  data  tends 
to  be  shorter  than  the  original,  more  modern,  more  coherent  and 
consequential,  and  these  errors  increase  with  time. 

With  Increased  time  there  Is  more  "constructive  remembering,"  or 
invention,  and  people  are  often  more  pleased  about  and  certain  of  those 
items  they  invented  than  those  they  accurately  recalled.  Posner  (1969), 
Franks  and  Bransford  (1971)  and  Bransford  and  (•’ranks  (1971)  found  that 
people  abstract  prototypical  or  average  schema  from  complex  visual  stimuli 
or  sentences  and  use  these  for  subsequent  recognition  judgments.  Further, 
subjects  rated  themselves  most  confident  of  having  seen  schenatic 
sentences  even  though  such  sentences  were  never  actually  shown  the 
subjects  in  the  original  sessions.  Related  experiments  (Barclay,  1973; 
Bransford,  Barclay,  and  Franks,  1972)  found  that  subjects  store  not  only 
information  from  complex  data  but  also  implications  and  inferences  fro™ 
the  data.  These  latter  may,  however,  be  recalled  as  having  been  in  the 
original  data.  In  other  words,  schemas  are  abstracted  from  complex  data 
and  stored  in  memory,  while  other  details  of  the  stimuli  are  lost  or 
stored  less  efficiently.  During  recall,  the  schema  is  used  to  recreate 
the  stimuli  or  to  decide  if  new  stimuli  are  from  the  same  category 
(Tsujimoto,  1978).  Schemas  capture  the  typical,  average  general 
properties  of  the  complex  data  and  then  bias  subsequent  recall  or 
recognition  toward  the  schema. 

The  debate  between  Vigor  and  HeeGwirc  (SNIP,  ehs.  32,  33)  on 
Admiral  Gorshkov's  use  of  the  phrase  “command  ofT the  *«m-  may  bo  a 
passible  example  of  blas-to-sehema.  Vigor's  reading  of  recent  Soviet 
doctrine,  and  activities  allows  him  to  view  the  concept  of  command  el  ths 
sea  as  indicative  of  future  Soviet  naval  strategy.  KeeOwire  seemingly 
argues  that  the  main  features  of  “ command  of  the  are  net  actually 
present  in  Gorshkov's  advocacy  or  in  Soviet  naval  doctrine,  although  they 
say  be  in  a  Western  prototypical  view  pi  Gorshkov's  writings  or  Soviet 
actions*  NeeGvir©  implies  that  Vigor's  s;hema  is  too  abstracted  from 
Soviet  doctrine  and  practice,  and  the  apparent  resemblance  between 

of  the  sea"  concepts  and  Soviet  doctrine  is  due  to  the  absence  ©f 
details  of  that  doctrine  that  were  lost  in  the  schematic  abstraction. 
When  those  lost  details  are  considered,  HeeSwire  implies,  ‘'command  of  the 
sea'  no  longer  appears  representative  of  Soviet  naval  doctrine  or  strategy 
(see  fiecGuire,  1979 1  for  further  discussion  of  Gorshkov  and 
“eofesaud  of  the  sea'). 

Naval  analysis,  like  other  forms  of  military  intelligence, 
requires  extensive  recall  of  past  events  and  data.  Analysts  seer*  to 
develop  the  ability  to  recollect  great  amounts  of  Information,  it  seems 
quite  likely  that  this  experience  parallels  the  highly  accurate  recall  and 
rapid  oetsory  storage  feats  noted  in  expert  chess  players.  Such  experts 
can  study  a  chessboard  for  only  a  few  seconds  and  recall  each  piece's 
location,  and  retain  these  memories  for  weeks  or  months.  Such  recall  is 
possible,  however,  only  for  meaningful  board  positions;  chess  pieces  which 
are  placed  randomly  ate  no  move  readily  remembered  by  the  experts  than 
they  ace  by  novices.  Studies  of  the  eye  movements  of  the  chess  experts 
show  they  literally  focus  on  the  fees*  important  strategic  relations 
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between  the  pieces  (Klatcky,  1975)*  Similarly,  the  excellent  recall  of 
naval  analysts  probably  results  from  their  abilities  to  fit  data  into  a 
meaningful  context,  or  to  determine  its  promising,  potentially  relevant 
features,  so  that  when  a  new  context  is  formed  they  can  recall  the  earlier 
data  ohich  could  now  be  fit  into  the  new  context. 

Demonstrations  of  this  context-triggered  reorganisation  of  memory 
and  previously  stored  data  abound  in  naval  analysis  (indeed  in  all  forms 
of  research  and  scholarship).  For  example,  derrick's  (NFSP,  ch.  9) 
ana’vsis  of  the  USSR's  “blue  belt  of  defense“  concept  of  asea  area 
defense  sone  required  the  integration  of  a  variety  of  comments  on  the 
“blue  belt.“  made  by  communist  spokesmen  in  several  Warsaw  Pact  nations 
over  many  years  with  indirect  evidence  from  Soviet  doctrine  and  exercises. 
Disparate  data  which  had  in  common  the  mention  of  the  “blue  belt”  were 
integrated  with  data  that  implicated  a  system  of  sea  area  defense  to  yield 
a  concept  of  a  unified,  mult i -service  military  plan  for  defense  against 
seaborne  nuclear  attack  by  Western  aircraft  carriers  and  Polaris/Poseidon 
submarines. 

In  summary,  memory  scholars  (e.g. ,  Klatsky,  1975;  Norman,  1969; 
Posner,  1973)  find  that  for  material  to  he  stored  in  long-term  memory,  it 
must  be  integrated  with  existing  concepts  and  fit  the  schemas  created  by 
previous  data.  This  schema- linked  storage  may  bias  retrieval,  however. 
For  example ,  fuvkhwmt  <I96§}  had  people  classify  objects  according  to 
color  or  shape,  Subsequently,  they  were  better  in  speed  and  accuracy  of 
recall  when  allowed  to  use  eh#  original  classification  scheme  than  when 
forced  to  use  a  new  set  of  categories.  In  other  words,  memory  is  #ft#r«h«d 
effortlessly  provided  that  the  context  at  the  time  of  retrieval  (problem 
context)  matches  the  organisational  s instil 4m *-%de  at  input,  l*m., 
if  the  data  at  retrieval  are  “context  addressable “  (Shilfrin  and  atfclnsea, 
1969),  tf  the  context  at  retrieval  requires  a  new  classification,  memory 
search  is  more  difficult ,  Typically,  however,  tire  problem  context  matches 
the  input  schema  only  for  easy  problems .  When  the  two  differ, 
inappropriate  data  may  he  recalled  (these  with  input  schema  similar  to  the 
problem  context  hut  not  necessarily  relevant  to  the  problem),  or 
appropriate  data  may  not  be  recalled,  or  the  problem  centext  say  be  skewed 
to  match  what  seem  to  be  appropriate  data  in  a  different  schema. 

Taxenemy  b  las  n  a ,  Two  organising  mental  structures  commonly  used 
in  memory  are  ordered  lists  and  hierarchies,  i.e,,  taxonomies,  these 
structures  can  bias  recall,  Nany  personal  experiences  appear  to  be 
organised  in  memory  as  lists,  however  multidimensional  events  tend  nut  to 
be  ordered  in  memory  on  lists  of  several  diaensions  but  rather  along  a 
single  dimension.  Debate  (1961)  noted  that  peonies  *  impressions  of  others 
on  a  variety  of  dimensions,  such  as  voice  quality  and  intelligence,  tend 
to  be  highly  correlated;  i.e.,  those  judged  high  in  one  quality  arc  also 
judged  high  On  others,  this  tendency  to  See  various  qualities  as 
co-occurring  has  been  termed  the  “halo  effect”  by  social  psychologists. 
The  implication  is  that,  for  certain  discriminations  and  judgments,  people 
tend  to  collapse  various  dimensions  into  one,  and  to  generalise  *eoet  that 
one  dimension  to  others. 

There  is  a  tendency  for  naval  analysts  to  view  Soviet  doctrine  and 
Soviet  naval  behavior  as  moving  in  parallel  (e.g.,  Hudson,  SNO) .  For 
example,  Hudson  views  Navy  and  Fatty  views  on  the  Soviet  fleet  as 
differing  in  the  late  1930s  and  early  1960s  oe  the  role  of  the  Navy  in 
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nonnuclear  wars,  with  Gorshkov  hacking  a  balanced  fleet,  and  the  A  ray  and 
Party  as  seeing  ocean-going  surface  ships  as  obsolete  Cor  nuclear  war  and 
coo  expensive  for  other  casks.  Hudson  sees  the  Party  views  as  going 
together  with  “the  foreign  policy  initiatives  of  the  Soviet  Union  and  the 
generally  relaxed  international  atmosphere  during  this  period  U953-ltl$7|“ 
(p.  279).  Gorshkov's  views  he  perceives  as  going  together  with  various 
uaval  activities,  e.g.,  maintenance  of  a  surface  fleet,  and  development  of 
balanced  naval  forces.  The  naval  evolution  since  1953  is  seen  as  due  to 
“unremitting  pressure"  for  change  from  Soviet  Navy  officers.  A  closer 
examination,  however,  of  the  events  of  the  international  atmosphere  at 
that  time  might  not  suggest  that  it  was  relaxed,  as  Hudson  believes.  And 
the  analysis  of  the  Soviet  construction  CHccGwire,  SNO :  lb?-92)  eases 
doubts  on  the  “balance”  of  the  fleet  or  an  institutional  commitment  to 
surface  ships.  The  correlations  between  Party  views  and  atmosphere  and 
between  Gorshkov’s  statements  and  naval  programs  may  be  due  in  part  to  a 
“halo  effect.” 

Stereotyping There  is  strong  evidence  that  memory  of  concepts 
has  a  hierarchical  structure  Cn.g,,  Warren,  1972).  Here  importantly, 
statements  which  are  not  represented  by  hierarchical  structures  tend  to  be 
altered  in  memory  so  that  they  can  be  (pawes,  19&6).  Per  example,  Qawes 
esmpared  memory  of  statements  of  the  form  “gome  &  are  Y“  with  those  of  the 
form  “Ail  Cs*  he)  f  are  t"  and  found  that  “some"  statements  are  more 
likely  to  be  recalled  as  “ail“  or  “no”  statements  than  the  reverse.  This 
preforence  for  ayseiute  and  warms  eoneepts  (“all"  or  “no”)  relative  to 
relativistic  §r  ambiguous  concepts  {“sra®*}  pervades  other  anafyfia  task# 
as  well.  A  further  character istic  of  hierarchical  organisation  is  that 
properties  @f  classes  are  of  tan  represented  at  Higher  level#  ‘"birds 

fly”)  and  these  properties  are  then  applied  to  lower  levels  <».$»,  '"eagles 
fly").  this  can  lead  to  sis  application  of  properties  (§.§»,  “ostriches 
fly”).  farther*  properties  are  often  assigns!  a  class  on  the  hasi»  of 
ohgorvations  of  a  cube  lass  or  single  somber  U*g*«  "eagle#  are  kilter#,” 
therefore  “birds  are  *llo?s“).  Such  thinking  Is  termed  'stereotyping" 
and  may  he  due  in  part  to  the  organisational  structure  of  semc-cy.  The 
implications  @f  hierarchical  mmff  structure  are  that  class  assignments 
are  eomot Imeo  inappropriate,  aa4  inference#  from  properties  of  individuals 
to  properties  of  classes  and  vice  versa  are  not  always  thought  out. 
f’eople  assume  natural  categories  have  the  properties  of  classical  logical 
categories  Ce.g.,  rigid  boundaries)  when  they  do  not. 

for  example,  naval  analysts  have  noted  that  th-^  Soviets  designed 
several  classes  of  surface  ships  for  ant|*sn#face  warfare  and  used  such 
ships  in  task  groups  during  crises,  apparently  to  counter  U  $»  aircraft 
carrier  task  groups.  There  is  a  tendency  for  analysts  to  treat  ail  Soviet 
ships  in  ft&f  task  groups  as  being  specially  designed  ®issi ie^armed  types 
(e.g.,  Heraog,  hk§g:  39»4&) *  Tor  example,  Roberts  Cin  Sigmofces  and 
KcConnell,  1979;  l&H)  writes  of  the 

Jtore  nr  less  standard  ant  leaf  tier  task  groups  .  .  »  coopted 

of  $$$  and  $AN  surface  units  and  cru ise-wissi le  and 

torpedo-attack  submarines. 

tn  fact,  Cosy  somse  of  the  ship.a  that  undertake  the  AC&i  task  in  crises  are 
■tissiic-avaed;  others  are  older,  gun*arned  vessels. 


8? 


Extreme  cases.  Because  isolated  and  striking  details  of  data  are 
important  in  creating  prototypes  and  schema  in  memory,  there  is  a  strong 
tendency  to  recall  or  recognize  unique  or  striking  information  with  little 
loss  of  detail  even  over  long  periods  of  time  (Rock  and  Englestein,  1959). 
Mneaonists  (individuals  with  greater  than  usual  memory  capability) 
attribute  their  prodigious  memory,  in  part,  to  their  ability  to  experience 
each  particular  datum  as  a  unique  instance  (Luria,  1968).  There  are 
several  implications  of  this  characteristic  of  memory.  First, 
nonoccurrences  of  events  and  negative  instances  are  rarely  as  striking  or 
unique  as  occurrences  or  positive  instances,  and  will  tend  to  be  less 
vell-remerabared,  as  was  noted  above.  Second,  because  unique  and  striking 
events  tend  to  be  well-remembered,  relative  more  commonplace  events,  they 
tend  tc  be  over  influential  when  estimates  are  made,  because  of  the 
availability  heuristic.  Third,  the  perception  of  physical  stimuli  tends 
to  be  affected  by  the  so-called  "central  tendency  of  judgment  v  ”  that  is , 
smaller  stimulus  values  are  overestimated  and  larger  ones  are 
underestimated.  These  inaccurate  sensation  judgments  are  compounded  when 
psychophysical  sensations  are  stored  in  memory,  i.e.,  smaller,  weaker 
values  are  further  overestimated  and  larger,  stronger  values 
underestimated.  Since  "smallest,  least,  weakest and  “strongest, 
large.** *  most"  are  striking  and  unique,  they  tend  *o  be  well-remembered  in 
terms  of  detail  but  not  in  terms  of  actual  magnitude.  Further,  the  “law 
of  sense  memory”  suggests  that  the  more  extreme  the  stimuli,  the  more 
distorted  the  memory  of  its  magnitude  relative  less  extreme  stimuli.  In 
short,  perception  compresses  magnitude,  memory  does  so  even  more,  and 
compression  is  most  severe  for  those  stimuli  most  likely  to  he  recalled. 
Fourth,  the  distinctiveness  of  striking  and  unique  data  tend  to  isolate 
them  from  other  data,  thus  improving  their  memorability,  hut  also  reducing 
the  ability  of  the  individual  to  integrate  these  data  with  others ,  In 
effect ,  the  classification  of  data  as  unique  protects  it  from  forgetting 
or  interference  while  in  memory,  hut  may  also  isolate  it  stem  further 
cognitive  integration,  unless  such  integration  explicitly  involves  other 
distinctive  cores. 

hothbars  and  colleagues  (tothbars,  Fulero,  Jensen,  huustd  sad 
iimU,  presented  people  with  information  on  individuals  and  asked 

them  to  make  judgment*  about  the  characteristics  of  the  group  composed  of 
those  individuals.  Ir  one  test,  the  Heights  or  two  groups  of  individuals 
uera  give#,  and  in  both  mac?  percent  were  ever  six  feet  tall*  Hew* ear. 
in  one  group  those  over  six  feet  ware  moderately  fail  (6*  i“  to  6 *  4“* 
while  Individuals  in  the  other  group  were  mty  tali  Cl*  to  &*  H  ) 
fmpht  estimated  the  percentage  over  six  foot  in  the  first  group  at  about 
twenty  per earn t,  but  at  thirty  percent  for  the  second  group,  Similar 
results  were  obtained  ter  two  groups  fur  which  the  severity  &£  ttim  wag 
uaiuip'ulated*  la  other  the  frequencies  of  extreme  cases  were 

evsirustiestted  when  these  eases  were  sore  salient. 

to  xum-eearlee,  the  following  features  of  memory  will  tend  to  bias 
data  efeasaeturisatieus 

©  Hemury  roc.unst ruet i oos  streamline,  condense,  and 
input  data*  iittisg  it  to  preexisting  schema. 

o  “Constructive  -  rc«eisbrri«g"  (i^veatiou)  increased  with  time  and 


people  are  often  most  pleased  with  and  confident  of  the  fidelity  of  such 
memories.  These  constructions  tend  to  reflect  the  characterization  schema 
used  by  the  individual  to  organize  the  input  data. 

o  Recall  and  recognition  tasks  which  match  in  context  the 
organization  schema  of  memory  inputs  can  be  performed  relatively 
effortlessly.  Recall  contexts  which  do  not  match  memory  schema  require 
greater  mental  effort. 

o  Memory  lists  fail  to  capture  the  multidimensional  attributes  of 
stimuli,  producing  the  “halo  effect  M  and  the  assumption  that  favorable  or 
unfavorable  qualities  co-occur. 

o  Hierarchical  organization  of  memories  is  often  misapplied  to 
nonhierarchicai  inputs,  or  applied  too  rigidly,  producing  stereotypes,  the 
assumption  that  attributes  of  members  of  a  class  extend  to  the  entire 
class.  That  is,  data  that  are  stored  as  “fuzzy  sets"  may  be  recalled  in 
the  belief  that  they  are  aii-or-nono  sets. 

Q  Striking  details  tend  to  bo  beat  recalled  but  also  tend  to  be 
most  iompressod  in  magnitude  toward  less  impressive  data.  The 
distinctiveness  of  striking  details  nay  prevent  their  Integra '.ion  with 
ether  data  in  memory  and  *ead  tc  everts time cion  of  their  trequeucy,.  Since 
negative  instances  are  generally  less  striking  than  positive  instances, 
the  romer  arc  le-va  memorable  and  less  available  for  further  cognitive 
work.  Striking  details  will  be  readily  integrated  only  with  other 
striking  details 

The  tendency  for  extreme  or  striking  details  to  be  integrated  only 
with  other  striking  details  is  an  instance  M  the  segmentation  of  evmts 
in  such  a  way  that  maximises  commonality  among  elements  within  the 
category  and  differences  between  categories*  This  is  entirely 

reasonable,  hut  does  f,«,  help  doteraAos  which  dimensions  are  actually  used 
to  distinguish  eate-gorlen.  H&tfcbaxt  <19$);  *?>  suggests  that  predictive 
value  is  one  criteria  for  categorization.  Th&  Soviet  8»vy  is  nut  usefully 
categorized  as  “a  m?f*  because  that  Him  to  distinguish  it  from  other 
navies*  however,  the  categorisation  of  lt:  m'  "a  navy  Ht  coeval we 
diplomacy1'  offers  predictive  ual««  by  ■  disbihguishing  it  and.  suggesting 
what  is  can  or  sight  do*  The  seieetiofl  M'  thus  reveals 

ansethiftf  about  the  analyst ‘§  prior  expee  t it i an  a  abo  u  t  meaningful 
dimensions,  in  figure  4*1,  she  categories  of  ' “iftbfctastsT •««*» 
eh&sen  because  the  analyst  perceived  the  possibility  oik’:  predicting  one 
ism  the  other. 

An  exanyie  of  categorisas  ion  in  naval  analysis  is  H«Qasune-U*t 
elasstiieailsm  of  cases  in  Soviet  Thitd-Uor Id  di-pl&nt&oy  of  £«**««  (id 
Msmvkes  and  McConnell.  Sit),  which  has  thrs#  divia.i&us  gwid 

seven  vase  categories  within  divisions  (tee  Table  4*2).  The  fact  that 
Murmur e U’e  divisions  refer  to  thw  high  seas  and  the  Third  tfur id , .  '  for 
esample,  l exiles  that  he  dees  not  see  a  naval  diplomacy  of.Ior^e  *#  like  .7 
against  the  first  ihrUd 

Mat.^.tn i  t use  lo&ina *  it  is  eysrtby  that  'Mcgonneil*s 
eiassifidalioa ' is  similar  to  those  observed  t>y ’ysycluj'l.ogists  in  natural 
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Table  4.2 


McConnell's  Classification  of  Cases  in  Soviet  Third-World 
Diplomacy  of  Force* 


Case  Divisions  Case  Categories 


1.  Security  on  the  1.  Demonstration  of  intent  to 

High  Seas  protect  USSR  assets,  or 

the  assets  of  clients,  at 
sea. 

2.  Third  World  2.  Demonstration  of  support 

Domestic  Security  for  the  domestic  authority 

of  an  established  government 

3.  Demonstration  against  an 
established  government  in 
defense  of  Soviet  citizens 
and  property. 

4.  Military  support  to  a  domestic 
faction  during  any  inter¬ 
regnum  when  the  U.S.  is 

!  inhibited  from  counter- 
involvement. 

3.  Third  World  5,  Demonstration  of  intent  to 

International  protect  a  client  in  a  can- 

Security  flotation  with  a  state  that, 

held  in  odium  by  the  international 
community,  does  not  enjoy  U.S. 
patronage.  •' 

/  •  6*  Demonstration  of  support  for  a 

client  threatened  Car.  that  might 
be  threatened)  by  a  Western  great 

■  power  or  in  actual  conflict  with 
.  -  •  ■  such  a  poser.  ': 

?*  Deftonttrabion  or  actual  lot 

vantion  against  a  U»§*  client,  that 

Is.  defeating  a  Soviet  client,- 


WfiffiRSSSSSSS  and  McConnell  tim%  232-253). 


Types  of  Display 
Attentlonal 
Purposeful 
Temporizing 
Limiting 
Supportive 
Exemplary 
Expressive 


semantic  taxonomies;  namely  people  tend  tc  apply  three  levels  of 
classification,  with  the  optimal  level  of  abstraction  at  the  middle  level 
(sue  Cantor  and  Mischui,  1979:  13-15  for  review).  At  the  middle  level 
people  use  broad,  inclusive,  but  still  rich  and  distinctive  categories, 
inclusive  enough  to  cover  many  kinds  of  objects  or  events  in  a  category, 
but  also  detailed  and  vivid  enough  to  allow  a  description  in  great  detail 
of  the  prototypical  category  member,  and  to  distinguish  a  category  from 
others  at  the  raiddiu  level.  Objects  or  events  categorized  at  the  middle 
level  are  roally  different  and  share  few  features,  while  objects  and 
events  at  lower  levels  (e.g.,  instances  of  defense  of  Soviet  assets  on  the 
high  seas)  may  have  many  common  features.  Note  that  the  categories  at  the 
same  level  in  a  taxonomy  tend  fo  be  psychologically  continuous  —  without 
clear-cut  boundaries  —  but  clearly  separable  on  the  basis  of  clear 
prototypical  cases  of  each*  It  is  the  estimation  of  the  degree  of 
prototypicality,  rather  than  a  search  tor  necessary  and  sufficient 
features,  that  psychologically  mar’-i  peoples'  judgments  of  how  well 
various  objects  or  events  fit  a  particular  category  label. 

The  "fuzzy  set”  nature  of  complex  natural  categories  and  the 
difficulty  in  specifying  all  the  features  which  give  members  of  a  natural 
category  a  family  resemblance  contribute  importantly  to  the  conflicts 
between  naval  analysts.  For  example,  there  are  characteristics  of  Soviet 
ships  that  suggest  they  would  be  effective  deterrents  to  interventions 
during  crises  by  Western  aircraft  carrier  task  groups.  Overlapping 
characteristics  of  these  ships  give  them  the  appearance  of  effective 
elements  in  a  "blue  belt  defensive  plan"  against  nuclear  strikes.  Since 
these  diplomatic  and  strategic  missions  share  many  features,  deciding 
whether  a  particular  event  is  best  characterised  as  one  or  the  other  may 
be  difficult.  Often  analysts  can  do  no  more  than  to  conclude  that  a 
particular  event  was  more  like  the  one  tatogory  and  less  like  the  other 
but  also  a  little  like  both.  Nor  does  it  seem  to  be  any  easier  to 
categorise  doctrinal  writings,  ship  construction,  or  deployment  patterns; 
ail  these  complex  events  can  be  categorized  as  having  a  family  resemblance 
to  strategic  or  diplomatic  missions,  offensive  or  defensive  objectives, 
cautious  or  expansive  tendencies.  To  characterise  any  of  the  complex 
elements  of  Soviet  naval  behavior  as  belonging  to  only  one  of  these 
categories  is  to  overlook  the  psychological  nature  of  the  analytic  process 
and  the  richness  and  ambiguity  of  ail  natural  phenomena. 

The  best  naval  analysts  recognise  this  and  treat  their 
categorisations  as  matters  of  degree  (although  they  often  neglect  this 
probabilistic  nature  when  explaining  events  or  drawing  conclusions).  ¥or 
example,  Weiniand  (SKij  50?)  writs* * 

There  is  a  continuous  dimension  to  Soviet  naoai-diplotaatju 
activity,  the  lo«  intensify  continuing  impact  of  oav&l 
presence  has  eluded  measurement  by  students  of  naval  power 
*  *  the  Soviets  apparently  I  ini  crisis  management  a  mta  or 
loss  cent inuous  task . 

The  eajet  challenge  to  those  naval  analysts  is  tracing  and  weighing  these 
overlapping  and  crisscrossing  categories  of  Soviet  intentions  and 
behaviors,  there  ^ay  be  little  point  to  tarrying  on  the  tradition  of 
viewing  Soviet  naval  events  in  "sU‘u*r- ov~  categories.  A  mere  profitable 
approach  stay  be  to  determine  prototypical  cases  and  attempt  to  ooasure  the 
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distances  between  prototypes  and  specific  events.  An  explicit  effort  to 
measure  "family  resemblances"  rather  than  to  debate  pigeonholes  may  be 
more  meaningful  both  psychologically  and  analytically. 

Generalizations  and  representativeness.  Among  the  most  important 
characterizations  of  data  made  by  analysts  are  generalizations,  inferences 
about  a  population  on  the  basis  of  evidence  on  a  sample  trora  that 
population.  Generalization  is  a  central  aspect  of  scientific  inference 
and  rules  for  valid  generalization  have  evolved.  These  rules,  however, 
are  rarely  characteristic  of  natural  generalization  (cf.  Rothbart,  1980). 
The  rules  for  scientific  generalization  are  (i)  define  the  appropriate 
sampling  domains  relevant  to  the  issue,  (2)  sample  representatively 
(fairly)  from  the  appropriate  domains,  (3)  code  data  into  categories  using 
unbiased  rures,  (4)  compute  contingency  between  measurements,  (5)  retain 
or  discard  hypotheses  about  relationships.  People  do  not  naturally  fallow 
these  rules  or  apply  them  validly  when  generalizing.  For  example,  they 
neglect  the  size  and  variance  of  the  sample  and  generalize  from  very  small 
samples.  They  allow  their  hypotheses  to  influence  the  definition  oi 
sampling  domains,  sample  selection,  and  data  coding. 

People  making  judgments  are  insensitive  to  the  statistical  "law  of 
large  numbers."  This  law  describes  how  large-sample  statistics  approach 
corresponding  population  statistics.  The  larger  the  sample  the  mere 
accurately  its  statistics  will  reflect  the  population.  On  the  other  hand, 
small  samples  may  differ  markedly  from  the  population,  and  small  samples 
from  different  populations  way  bo  very  similar.  Generalizations  based  on 
s»$il  samples  will  tend  to  be  less  accurate  than  those  based  on  larger 
ones « 

This  tendency  to  neglect  sample  size  and  variance  may  be 
particularly  strong  in  naval  analysis,  with  its  heavy  reliance  on  case  and 
class  analysis.  A  particular  single  case  study  or  ship  class  may  seem 
highly  representative  of  some  naval  behavior  or  mission.  The  single  case 
or  class  may  then  form  the  basis  for  analytic  generalizations  about  future 
Soviet  behavior.  Such  small  samples,  however,  are  likely  to  vary 
considerably  from  the  population  of  cases  or  classes* 

For  example,  both  the  Kiev,  and  Moskva  aircraft  carriers  seem 
somewhat  representative  of  Western*-  aircraft  eat  tiers,  .However,  both  have 
been  designed  tor  a  much  different  set  of  missions  than  those  of  Western 
carriers.  the  Soviet  carriers  are  apparently  what  the  Soviets  have 
libeled  them;  large  anti-submarine  warfare  cruisers  Cef*  Herzog,  KPSP 
A1,  49-SP,  Kec6wire,  JgJIP?  8$,  91-92),  Similarly,  the  use  o';-  the 
KUdin  and  Kashin  classes  to  shadow  U«$,  carrier  task  groups  during 
tied leer r a nesn  “cri $ es  and  the  presence  of  a  rear-firing  missile  system  on 
three  osKs  seemed  representative  of  anti -surface  ship  classes  <e*g,, 
Roberts  in  «i*mukes  and  HeCeoacll,  I9?9j  219).  It  now  seems,  however 
that  these  classes  carry  only  A&w  missiles  in  the  aft -facing  launchers 
^MccGwire*  KPSF;  94-95)*  In  terms  of  their  overall  surface  construction 
and  conversions,  large  Soviet  surface  ships  are  designed  for  ASW  missions 
(Kurphy,  HPSP:  ill),  however,  small,  vivid  samples  of  behavior,  such  as 
Shadowing  'of  if, 8.  carrier  groups,  may  lead  analysts  to  ascribe 
anti-sot face  capabilities  to  Soviet  ships  in  excess  cf  vlut  realty  exist. 

In  addition  to  en  insensitivity  to  sample  size  people  tend  to  be 
insensitive  to  sample  bins.  Unless  a  ssaple  is  unbiased  (selected 
randomly),  or  the  biases  are  known  and  can  be  compensated  for,  a 
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gunernltisat  ion  based  on  the  sample  will  also  be  biased.  One  eften 
overlooked  bias  is  that  produced  by  role  contexts,  i’or  example,  Ross, 
Amabile,  and  Steinmetx  (19/7)  found  that  certain  social  roles  lead  to 
biased  behavior  samples,  e.g.,  a  person  asking  hard  questions  appears 
knowledgeable  (knowing  all  the  answers)  while  the  person  being  asked  the 
questions  seems  less  intelligent  (getting  questions  wrong).  The  rob***, 
rather  than  the  peoples'  activities  predispose  these  percept 
Observers  of  individuals  in  these  roles  tend,  however,  to  attribute 
different  perceptions  to  abilities  not  roles:  the  questioner  is  beliuved 
to  be  more  knowledgeable  than  the  person  being  questioned., 

A  similar  phenomenon  has  occurred  repeatedly  in  naval  analysis  of 
superpower  crisis  behavior.  The  Soviet  Navy  is  often  perceived  as 
attempting  to  counter  or  deter  U.S.  naval  intervention  in  the  Third  World* 
Since  the  Soviet  Navy  began  such  demonstrations  in  1967,  the  U.S.  Navy  has 

not  launched  air  st. ikes  or  landed  Marines  in  any  of  the  crises  which  also 

involved  the  Soviet  Navy.  The  'Soviet  role  of  "deterrer**  conveys  a  highly 
biased  sample  of  behavior,  since  the  U.S.  Navy  may  have  been  just  as 
likely  to  not  intervene  If  the  Soviets  had  not  been  present.  The 
deterrence  role  appears  successful  if  nothing  happens:  if  Che  party  being 
(supposedly)  deterred  uoes  nothing,  the  party  doing  the  deterring 
(supposedly)  is  obliged  to  do  nothing,  except  make  tacit  or  overt 

threatening  gestures.  So  long  as  the  "deterred'*  party  does  nothing  (for 

whatever  reasons),  these  threats  need  not  be  executed;  they  can  actually 
be  bluffs.  Only  if  the  supposedly  deterred  party  ignores  the  threats 
(i.e  ,  turns  out  not  to  be  deterred  after  all)  'a  the  deturrvr  forced  to 
act  and  make  good  Che  threats.  U*  the  deferrer's  bluff  is  not  likely  to 
be  called,  the  deterrer  can  mkt  repeated  deterrent  threats  which  appear 
successful  and  effective.  It  may  well  be,  however,  that  in  each  ease 
there  was  little  or  no  likelihood  of  U.S,  intervention,  or  of  Soviet 
willingness  to  back  up  the  threat.  The  role  advantage,  however,  goes  to 
the  deterrer,  i.e;.,  the  Soviets, 

In  other  words, the  Soviets  can  easily  gain  the  appearance  of  a 
successful,  effective  eownterferee  by  their  efforts  to  deter  what  the 
United  States  was  unlikely  to  do  anyway.  Unless  the  U.S,  Navy  is  willing 
to  call  tneir  bint t ,  the  Soviet  Navy  obtains  a  role  biased  advantage  at 
relatively  little  cost.  The  perception  of  observers,  or  analysts,  is 
likely  to  bo  that  the  Soviet  Navy  caused  the  tt.$»  Navy  not  to  intervene. 
The  eulfitude  of  other  factors  which  wight  have  caused  U.S  * 
nonintervention  (e-g»,  a  lack  of  any  U*S.  incentive  to  intervene)  are 
overlooked,  and  the  biasing  role  of  deterrer  is  neglected.  The  estimate 
is  that  the  Soviets  have  succeeded  In  preventing  U.S*  intervention* 

There  is  xone  evidence  that  the  Soviet  Navy  itself  has  not  fallen 
viutiw  to  this  bias.  In  situations  during  which  the  U.S*  Navy  was  likely 
to  call  the  bluff,  e.g**  in  p>  t  .arc rotations  off  Vietnam  and  Korea,  the 
Soviet  Navy  has  tended  to  stay  c\ear  and  has  aade  little  pretest  about 
deterrence  (e»g»,  see  McUonneit  in  ftis«uke*  and  Hcgonnelt,  1979:  362). 
fcveo  In  those  cases  where  the  Soviet  Navy  is  ostensibly  deterring  or 
countering  U.S*  task  forces  (e.g.,  in  the  October  197)  crisis)  the  Soviets 
see**  to  have  taken  pains  to  stick  to  anti-carrier  exercise  routines  so 
that  U.S,  Navy  officer*  could  recognise  then  as  exercises  father  than 
actual  threats  Ccf .  Huberts  in  Uisookes  and  ftcUenneli*  1979:  219),  and  the 
Soviets  even  went  so  far  fro«s  actual  operational  practice  as  to  operate 
submarines  extensively  on  the  surface,  a  foolhardy  nove  for  anyone  really 
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expecting  trouble. 


Hindsifihtful  categorizations.  One  of  the  strongest  sampling 
biases  tends  to  occur  via  hindsight.  Once  a  person  forms  a  tentative 
Impression  of  a  set  of  data,  in  looking  back  over  past  events,  he  or  she 
may  make  systematic  retrospective  distortions  to  bring  those  data  into 
conformity  with  impressions  (Snyder  and  Uranowit2,  1978).  For  example, 
confirming  instances  may  be  selected  to  bolster  beliefs  and  disconfirming 
instances  may  be  overlooked.  Current  beliefs  can  exert  a  powerful 
channeling  effect  on  attempts  to  reconstruct  or  remember  the  past.  Events 
that  confirm  beliefs  are  readily  recalled,  while  other  facts  arc 
erroneously  recalled  in  ways  that  "confirm'’  the  belief. 

Perhaps  the  most  dramatic  instance  of  this  phenomenon  in  naval 
analysis  is  the  acceptance  by  Western  analysts  of  Admiral  Gorshkov’s 
assertion  in  1967  that 

...  by  1954,  Moscow  realised  both  the  need,  for  naval 
diplomacy,  to  compliment  the  other  instruments  of  its  new 
Third  World  policy,  and  the  need  for  patience  and  restraint 
until  the  proper  capabilities  in  this  role  could  be  acquired 
through  long-term  construction  programs  (McConnell,  in 
Dismuk.es  and  McConnell,  1979;  14). 

There  is  little  evidence  to  support  Gorshkov*®  claim  and  much  to 
refute  it,  as  has  been  noted  above  in  Chapter  3.  His  claim  does  provide  a 
simple  explanation  for  the  Soviet  Havy‘s  progress  toward  naval  diplomacy 
it  was  planned,  une  venders,  however,  how  it  is  that  the  Soviets  could 
be  so  foresightful  as  to  recognise  a  decade  in  advance  the  political 
importance  of  the  Third.  World,  let  alone  the  need  for  naval  capabilities 
for  diplomacy  there,  and  yet  be  so  shorts ighted  as  to  construct 
forward-projection  forces  which  were  heavily  dependent  m  b mm  and 
support  facilities  in  unreliable  noncoeaunlst  countries.  One  would 
expect,  for  example,  such  a  foresightful  adversary  to  spend  its  §6  billion 
m  a  more  profitable  relation  than  that  between  the  mi  hgypt > 

Biased  samp  linn,  gofhbaf  r  (1989;)  has  .outlined  in  general  tersas 
how  hi  used  samp  f  i  ng’ean  lead  to  teemingiy  irrefutable  (but  nonetheiessi 
biased)  evidence  ts  support  a  belief'. 

Suppose  for  the  sake  of  this  argument  that  Soviet  naval  behaviors 
can  be  tvygoibstiaaily  categorised  at  “diplomat  i§  t&fvasd’*  or  “strategic 
forward*  as  in  figure  4,3,  Panel  &  shows  the  total  data  set?  there  is  no 
change  in  behavior  between  the  two  periods  except  a  doubling  of  activity 
in  the  forward  area. 

Suppose,  however,  that  a  naval  analyst  with  a  diplomat!®:  (or 
strategic)  perspective  samples  data  from  the  past  on  Soviet  naval 
diplomacy  in  the  forward  area  (Panel  I),  'the  analyst  finds  the  Soviets 
have  doubled  the  St  dipl«SAtie  {«*  Strategic)  activity. 

"'"'  Wibe  other  hand,  an  analyst  concerned  with  the  “new*  Soviet  havy 
(Panel  €)  or  the  overall  pattern  of  Soviet  naval  behavior  in  the  forward 
area  (Panel  S)  would  find  that  Soviet  strategic  naval  activity  in  the 
forward  area  is  twice  as  likely  as  diplomatic  activity 

In  other  words,  one  set  of  data  and  different  sampling  biases 
allow  naval  analysts  to  arrive  at  different  perceptions  of  Soviet  naval 


Figure  4.3.  Example  of  Biased  Saucing 
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activity.  Several  widely  different  generalizations  about  Soviet  naval 
actions  in  the  forward  area  are  drawn,  none  being  entirely  accurate,  but 
all  completely  consistent  with  the  data  sampled.  If  all  four  cells  of  the 
contingency  table  in  Panel  A  are  utilized,  hal£**right  conclusions  are 
avoided.  However,  people  typically  look  only  at  confirming  data,  and 
rarely  consider  all  cells.  For  example,  “diplonatlc  forward"  is 
confirming  data  tor  the  diplomatic  analyst.  But  “strategic  forward"  is 
nonconfirming  and  may  not  be  viewed  as  relevant  by  the  analyst  interested 
in  naval  diplomacy. 

An  example  of  the  sampling  bias  can  be  found  iti  Petersen's 
analysis  of  Soviet  Navy  diplomatic  port  visits  (in  Disoukes  and  McConnell , 
1979:  91~92).  Petersen  argues  against  MccCwirc’s  thesis  that,  after  an 
initial  survey  of  ports  in  the  Indian  Ocean,  very  few  visits  were  made  to 
other  Indian  Ocean  countries,  and  diplomatic  visiting  there  fell  off  after 
1969*  Peterson  writes 

While  it  is  tree  that  a  drop  xn  diplomatic  visits  to  Indian 
Ocean  pores  was  registered  in  1970,  it  is  not  true  that 
"very  few"  visits  have  been  made  elsewhere  in  the  region 
since  then.  Between  1970  and  1976,  for  example,  no  fewer 
than  30  diplomatic  visits  were  made  to  Indian  Ocean 
countries  other  than  Somalia  and  South  Yemen,  in 
comparison,  only  2d  were  made  to  Mediterranean  ports  during 
the  same  period, 

Petersen  presents  Cp.  92)  tabulations  of  diploaustic  port  visits  for  the 
Indian  Ocean  and  the  Mediterranean  t«*  the  years  in  question  (see  Figure 
4.4).  Petersen  overlooks  two  important  base  rates-  first,  the  total 
levels  of  port,  visiting  in  %h**  two  second,  the  disproportionate 

time  periods.  Indian  Oseau  diplomatic,  visits  .watu,  over  the  total  tlmt 
period  If  67**19H»  twice  as  frwquofet  m  M#dl visits., 
.proportionately*  Indian  visiting  in  the  period  (Sit)  was 

teach  lets  than  Mediterranean  visiting  teeondly,  while  the  year 

ratio  between  the  two  tim  periods  is  $••?*  mi  the  ratio  ©f  visits  tn  both 
oceans  in  the  two  periods  is  1M$»4*  the  ratio  of  Indian  Scsan  visits  in 
■  «fc$  two  periods  is  $.*.5 .’9*  romp-seed  the  Mediterranean  ratio  of  1-i.I,  In 
ether  words*  while  Medit.svranean  visits  ps-r  year  increased  over  the  two 
'  periods  <2J$  and  4|*  m*  Jtfci  fetaa  they  mi  there  were 

almost  twice  m  ■visits  $$c  yenr.ih  (tftj  in  the  Indian  tcean 

m  in  ii*ky*  .stsstsue  of  3d  to  2#  visits  is 

biased'  asd  tb@.:  patterns ' el  difios&tie  visits  in  tte  two 

-  rrijionS,..  ;i§.  parti tal&t ,  the  sharp  decile#  of  visiting  in  the  Indian  Ocean 

..:.  *#•  *'  .&a&kU$Ut  :1»  '$«  fcfesi  j&ditcrv&aeiu* . 

~  JlgdfcSattng  <»!gvar  1st  ions 

The  afes  1 1 1 y  so  discern  re Is'iSOttsMps  between  sets  of  decs  is  4 
:.  fw*dajt§ntal  skill  tat  4U  £s#pie  «#■' woii  si  asnJi.ysts*  toms|  the 
•■  relationships  V?ivs«s  warning@'4jj4  danger,  wr  baiwews  tcaefclisg  Mgm  and 
'  p*4f  is  4  basic  psij-.oi  svtvivsi.'- 

§s«llstrly*  Si4v#.5  &oaiysf£  most- assess  the  oovarisii^  between 
Soviet,  strategic  sees#  and  nad*i  aerivsllv*.  forward  dapteysent  and  tnsvai 
dlpionwcy.  poiif.icai' «wsMsi-t«toats  asd  -crisis  bohnvicc,  capabilities  aad 


actions,  etc.,  to  understand  and  predict  Soviet  naval  Intentions,  Naval 
analyses  are  sensitive  to  these  covariance  assessment  tasks  and  on 
occasions  have  identified  covariations  oi  great  relevance  to  the  Soviet 
Navy  which  have  been  inadequately  addressed;  e.g.,  the  relationships 
between  shifts  in  naval  policy  and  in  foreign  and  defense  policy,  the 
relationships  between  naval  policy  and  technical  developments  (HeeOwire  , 
JNJ:  ix). 


Tv  :fo'.d  tables,  tho  simplest  rcproscutct ion  of  covariation  is  the 
four  c*H  pe  «,*■  .t. -absence  table; 


Behavior  t 


Present 

Absent 

Present 

20 

10 

Indicator  A 

Absent 

BO 

40 

Even  with  this  simplest  Banner  of  representing  covariation  between  two 
events,  people  have  difficulty  detecting  covariations  (Smedslund,  1963; 
Ward  and  Jenkins,  196$), 

Among  the  common  problems  in  detecting  covariation  is  an  almost 
complete  reliance  on  the  “present /present"  (or  cell  in  the  four  ceil 
tattle*  People  will  tend  to  see  indicator  a  a#  associated  with  behavior  % 
simply  because  teseslMS  A  it  present  when  X  is  present*  Serna  people  will 
attend  two  ceils  (+•*>  and  +»)  and  csnclude  that  a  relation  exists  because 
there  are  sore  cates  of  £  with  A 'than  of  ea  X  and  A.  Others  mf  attend 
edit  **  mi  *»  and  decide  the  relationship  is  negative*  feehavier  £•  is 
indicated  by  the  absence  of  A».  Without  considering  all  feur  ceils,  m 
judgment  of  covariation  can  legitimately  be  ssde,  but  peeple  dm  eat 
intuitively  ennsider  more  than  one  ur  two  of  the  tells*  When  the  two 
variables  are  esntinnous  rather  than  d  I  chat  emeus  the  covariation 
estimation  prmbinm  hsvmm  eve»  banter* 

There  is  seme  evident®  that  naval  analysts  neca§t©s&i if  de 
estimate  eavatislis«  an  the  basis  of  one  «r  two  fathe-r  than  ail  four  cells 
in  the  lour  fold  table,  Far  eso&p;*,  Mswukvs  and  h&fcanuvii  (1919;  54*?) 
wrote 

the  variations  we  have  noticed  is  tte§Mw:*s  will rngness  .is 
exebaage  clirrnt  breaohv^  at  the  s  tarns  an*  ere  ilsked  to 
variations  in  Soviet  iaetleal  vleiis  da  the  exacerbation  and 
relaxation  of  tension* 

To  support  tMs  they  mention  oae  case  of  esriutapniK  and  sxirst^liM, 
(ff  nrjl v  1  In  Hi?,  and  two  easns  el  nsn^neouragenent  and  teiaxaiinn  (»* 
ceil)  In  and  l??Si  They  note  neither  the  engnuragewent 

relaxation  C+-  -sell)  nitussloft  (Soviet  sufperi  for  Ethiopia  night  be  as 
exaapie},  nor  tho  Gooeu£oarsge*e«t  and  exacerbation  <—*■}  situation  (bwviet 
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(WMiencourageisnat;  «£  Iran  or  Iraq  in  their  roetmt  conflict  may  fc«  an 
example).  While  the  existence  of  cases  in  the  and  **~  cells  is 
necessary  to  establish  a  positive  covariation,  it  is  not  stiff i cleat,  a 
relative  absence  of  casco  in  the  and  -+  coils  is  also  necessary. 

flee  luce  of  sttgaUvc  evidence,  In  part,  the  difficult}  people  have 
with  covariation  estimation  may  derive  from  the  general  failure  to  ma 
negative  evidence*  the  .titseoce  of  indicators  tends  to  be  overlooked  and 
people  forta  concepts  of  negative  instances  only  with  great  41  ricolty. 
the  heavy  reliance  on  positive  instances  C++)  my  reflect  people's 
inability  to  learn  readily  fro®  negative  instances  (see  *'f lone  vent  • '  above, 
and  fiisbett  and  Hess,  1948:  -49}  hason  and  Jeltftson-UHrd,  1%S}» 

. Hava!  analysts  have  not  coismented  on  the  lack  of  a  **••  .ftlomscy 
exercise*  by  the  Soviet  Ifavy,  i.e.,  naval  exercises  and  twovov,  -j  which 
are  explicitly  and  exelc -  vely  concerned  with  a  peacetime-  nr**'  ole  and 
suasions  well  short  of  general  war.  ?»ych  scenarios  are  often  "Elected  in 
Western  exercises  (especially  intervention  in  Third  World  -rises,  or  on 
behalf  of  Third  World  allies,  e.g, ,  South  Korea).  The  -•»  -tn.lng  “crises" 
phases  in  Soviet  exercises  are  extremely  brief,  and  .-aa  quickly  into 
general  m  naclear  war  missions.'  A  Soviet  exercise  thar  included  naval, 
airborne,  or  amphibious  intervention  in  the  Third  War  id  hut  which  did  not 
include  general  or  nuclear  war  aspects  would  be  extremely  strong  eviconee 
for  the  thesis  that  the  Soviet  ha vy  has  been  4«si.gne4  for  a  coorso  of 
conceive  naval  diplomacy  in  the  Third  World* 

d«  the  Qthet  hand,  negative  evidence  is  sometimes  seen  as 
significant  by  naval  analysts,  as  we  anted  above  under  “hone vent g  »**  Par 
example,  Thompson  11}  asks  why  Ad&i?ftl  Vershkov's  book,  faa  powar 

and  the., ft  ate  had  net  been  reviewed  (ii  of  February  l%tt)  by' cither 
Wavla  or  K|simupist.  these  naaevents  suggest  e hat  the  Admiral's  views  are 
net  eesf lately  accepted  as  doetfino  In  the.  Soviet  ttaisn,  l*e,»  th§f^«9a 
*h»it##S«  this  is  a  *»“  instJindo,  m  review,  and  no  Soviet  decision  m 
author it at ivenesa * 

Theory^riyea.  §n|  data.-if|yin.cnyariatlen  es|lgatns*  hi shaft  and 
8e§®  £ 1 i i~ "ossf irt^#ist:insVi^J^^€wegai,^data“4fivnn“'  and 
"sheory“4rive6“  judi’^nta  os  envariation*  When  ye&flt  have  »®  a  priori 
theory  or  eMp'Sctitlai*  oi  a  reiatioatHip,  strong  correlations  (e*g*,  t  *  *$ 
to  *§)  teaj|  t@  I®  yadarest imatad ,  s*<§>,  judged  &§  he  weak  folationahips* 
Ssiy  vhen  the  relationship  is  esttt&iiy  at¥«8g  Cr  *  ,t  to  1,8;  *  *  \S  is 
$  gerle**  £®tatl@n§hif*  m  mg  *#*iafeit  changes  the  other  ghanges  hy  a 
£f§y®fti$sial  a*&ao%)  people  ge?«tiee  it  m  a  itfaag  gavatiatiaa,  and 
they  still  tend  t#  greatly  mndosestl^te  the  strength  ®f  th®  . 

In  other  dasa^driven  eovatiatiana  are  to  hinf'ilti,  and 

when  ?$€&§$£ st£ *  are  endefesstmated?  Strong,  but  onempnetad, 
r  alationshtps  will  ten4  t®  he  ndssrd  *  fyt4hgf#@re»  '*  dasmy  feat  wren"  m 
the  data,  vhl^h  htsng  t®  stag  ingarreet  theories  ahaot  ©seatiatida,  may 

This  relatively  weak  pargeption  and  §i  *nats?rai*  f rather 

than  ®@.ts  etpated)  reveriet 4®s  has  import  ant  let  nava? 

«nalysi^-*  St-nlesn  an  analyst  empsetn  la  $i$4  a  teiatlaaship*  fee  ar  she 
will  tend  not  to>  not  lee  ®ae  uni  ess  H  is  very  «tr@w§.  this  «w?ans  many 
strong  sovafiatisfts  ie.g.,  r*  »i  to  ,i>  mill  ga  unnoticad,  or  win  ha 
unde  rest  iiftdied.  ?®te®tl*I  indlcaiers  s£  foture  Soviet  eeti^ities  may  he 
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overlooked  and  important  patterns  in  the  naval  data  may  be  neglected. 
Similarly,  an  analyst  may  fail  to  note  the  success  of  an  indicator  in 
predicting  future  events. 

In  this  respect  it  is  very  interesting  that  one  of  the  best 
quantitative  naval  analysts  sampled,  Petersen,  notes  correlations  in  his 
data  only  when  they  are  extremely  strong  (e.g.,  r  >  .8,  Figure  2.3,  Table 
3.3.,  Figure  3.2,  in  Dismukes  and  McConnell,  1979).  For  example, 
Petersen's  Figure  2.3  shows  an  extremely  strong  negative  relationship 
between  the  mean  age  of  a  class  of  Soviet  ships  and  the  percentage  of  that 
class  deployed  out  of  area  in  the  year  1975  (r  =»  -.91).  Describing  this 
figure  Petersen  writes  (p.  45,  italics  added): 

.  .  .  the  number  of  ships  in  a  class  that  operate  beyond 
home  waters  seems  to  be  related  to  the  age  of  that  class. 

Similarly,  in  describing  a  nearly  perfect  covariation  between  the  age  of 
Soviet  ships  and  the  number  of  diplomatic  visits  they  make  (r  =  -.98, 
Figure  3.2,  p.  98),  Petersen  writes  (p.  96)  "the  Soviets  apparently  prefer 
to  use  their  newer  large  surface  combatants  for  diplomatic  visits." 

On  the  other  hand,  there  are  important  covariations  in  Petersen's 
data  on  which  he  does  not  comment.  For  example,  the  negative 
relationships  noted  earlier  in  this  chapter  between  the  total  Soviet  ship 
days  spent  in  the  Indian  Ocean  and  the  number  and  length  of  diplomatic 
port  visits  (see  Petersen,  Table  3.2,  p.  92)  seems  unnoticed;  instead 
Petersen  writes  (p.  91) 

The  relative  intensity  of  the  Indian  Ocean  effort  is 
particularly  striking  and  would  appear  to  confirm  the 
prominence  of  political  concerns  in  the  Indian  Ocean 
squadron '8  mission  structure. 

It  would  seem  that  Petersen  did  not  expect  this  negative  relationship  and , 
despite  its  strength  (r  a  -.65  and  -.83),  overlooked  it  and  implied  the 
converse.  Similarly,  he  takes  no  note  of  the  tendency  across  all  oceans 
for  total  Soviet  out-of-area  ship  days  to  covary  negatively  (r  «*  -.74) 
with  length  of  diplomatic  port  visits. 

(I  again  apologize  to  Petersen  for  this  apparent  overattention  to 
his  work.  Being  one  of  the  few  analysts  who  adequately  presents  his  data, 
he  becomes  most  vulnerable  to  this  form  of  methodological  analysis, 
Petersen  is  probably  less  guilty  of  biases  than  others,  but  easier  to 
catch.  His  extensive  use  and  reporting  of  quantitative  evidence  is  highly 
commendable . ] 

On  the  other  hand,  if  a  theory  or  expectation  implies  a 
relationship,  it  becomes  much  easier  to  recognize  covariation  between 
variables  which  are  expected  to  be  related. 

For  example,  Weinland  noted  (NPSPi  263) 

Since  all  but  a  fraction  of  the  [.Soviet )  surface  combatants 
and  auxiliaries  that  operate  in  the  Mediterranean  come  from 
the  Black  Sea  .  .  .  changes  in  the  pattern  of  Soviet 
transits  through  the  Turkish  Straits  provide  rough  but 
generally  reliable  reflections  of  changes  in  [Mediterranean] 
deployments* 
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Weinland  is  entirely  correct.  Soviet  surface  combatant  transits  of  the 
Turkish  Straits  correlated  very  highly  (r  =*  .90  with  Soviet  Navy  ship 
days  in  the  Mediterranean,  1964-70  (see  Weinland,  Tables  10  and  11,  p. 
262-63).,  Auxiliary  transits  also  covary  strongly  (r  »  90)  with 
Mediterranean  naval  presence.  Karlier  in  this  chapter  we  warned  analysts 
against  the  temptation  to  treat  highly  correlated  (redundant)  variables  as 
independent  evidence  or  to  weight  them  equally  with  truly  independent 
variables.  Weinland  seems  to  avoid  this  problem  by  noting  the 
correlations  in  his  data. 

In  short,  if  a  particular  relationship  is  not  predicted  by  an  a 
priori  theory  or  expectation,  or  if  the  person  holds  a  theory  which 
incorrectly  presumes  a  weak  or  null  relationship,  there  is  a  tendency  to 
miss  or  underestimate  covariations  in  the  data*  Theory-driven 
covariations  are  much  more  easily  perceived. 

In  fact,  the  perceived  covariations  and  estimates  of  association 
based  on  theory  are  often  far  higher  than  are  justified  by  the  data. 
Theory-driven  covariations  are  often  overestimated,  to  such  an  extent  that 
variables  with  no  association  or  a  negative  covariation  may  bo  estimated 
to  have  a  strong  positive  correlation.  This  phenomenon  o£  “illusory 
correlation,"  already  mentioned  above  under  characterizing  data,  requires 
further  explanation. 

Perceiving  nonexistent  correlations.  The  psychological  analysis 
of  “illusory  correlation"  began  with  a  series  of  elegant  studies  by 
Chapman  and  Chapman  (1967,  1969;  Chapman,  1967).  They  investigated  the 
puzzling  finding  that  expert  clinical  psychologists  reported  observing 
associations  between  certain  projective  test  responses  and  particular 
t .ideal  symptoms  (e.g,,  parnoia),  although  repeated  validation  studies  of 
.he  rests  found  no  associations  with  symptoms.  In  other  wotds,  the  expert 
clinicians  were  inferring  personality  and  psychopathic  charneteristea  from 
invalid  indicators.  The  Chapmans  reasoned  that  beliefs  about  covariations 
often  result  from  semantic  associations  (rather  than  from  frequencies  of 
co-occurrence).  Thus  clinicians  might  believe  that  paranoids  would 
exaggerate  the  eyes  in  the  Uraw-a-Person  (DAP)  test,  even  though  the  MP 
has  virtually  no  predictive  validity.  In  effect,  common  semantic 
associations,  being  readily  available  mentally,  might  he  taken  as 
indicative  of  a  high  frequency  of  co-occurrence,  in  keeping  with  the 
availability  heuristic.  If  so,  these  semantic  associations  should  apply 
equally  to  nonexperts*  This  is  what  the  Chapmans,  foot  '  naive  judges 
reported  the  same  co-variations  in  random  pairings  of  signs  and  symptoms 
that  clinicians  claimed  to  nee  in  practice.  When  people  were  asked  to 
simply  rate  the  tendency  of  a  given  symptom  to  “call  to  mind"  a  given  body 
part,  the  ratings  were  highly  predictive  of  the  reported  (illusory) 
correlations.  The  body  part  most  often  called  to  mind  by  the  symptom  was 
the  same  that  expert  and  nonexpert  judges  perceived  as  co-varying  with  the 
symptom. 

In  a  cognitive  test  of  the  "illusory  correlation"  principle 
Chapman  (l‘)C«7)  presented  pairs  of  words  to  people,  the  left-hand  words 
were  semantic  associates  of  the  right-hand  words  (e.g.,  lion-tiger)*  the 
pairings  ware  equally  frequent  (e.g.,  1  ion -egg,,  appeared  as  often  as 
1  ion-tiger  and  bacon-eggs ) ,  thus  there  were  no  true  correlations  between 
the  appearance  of  a  left-hand  word  and  a  right-hand  word.  Nevertheless, 
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the  observers  reported  retrospectively  that  each  right-hand  word  appeared 
most  often  with  its  semantically  associated  left-hand  word. 

Using  the  Rorschach  test,  the  Chapmans  (1969)  provided  an  even 
more  conclusive  demonstration  of  illusory  correlation.  Two  responses  to 
the  Rorschach  consistently  differentiate  male  homosexuals  from 
heterosexuals.  In  addition  to  these  two  valid  indicators,  there  are 
several  signs  that  seem  intuitively  (but  not  In  fact)  to  differentiate 
between  heterosexuals  and  homosexuals.  The  Chapmans  found  that  practicing 
clinicians  commonly  reported  five  intuitive  indications  (which  are  all 
empirically  invalid)  as  most  characteristic  of  homosexuals,  while  the  two 
valid  signs  were  rarely  reported.  When  laypeople  were  asked  to  rate  the 
degree  to  which  homosexuality  called  to  mind  the  various  valid  and  invalid 
signs,  homosexuality  called  to  mind  the  five  plausible  but  invalid  signs 
but  not  the  two  valid  signs.  In  other  words  the  exports  and  the  laypeople 
shared  the  semantic  associations  between  the  invalid  indicators  and 
homosexuality,  but  were  unaware  of  the  valid  indicators. 

In  the  crucial  phase  of  the  study,  ths  Chapmans  showed  nonexperts 
pairings  of  the  valid  indicators  and  the  homosexuality  condition  which 
covaried  either  50  percent  (i.e.,  the  valid  indicator  co-occurred  half  of 
the  time  homosexuality  appeared),  6?  percent,  83  percent,  or  100  percent. 
The  invalid  signs  were  also  presented  but  did  not  covary  with 
homosexuality.  The  manipulation  of  covariation  of  the  valid  signs  did  not 
influence  perceived  covariation,  i.e.,  even  when  the  relation  between  the 
valid  signs  and  the  homosexual  condition  waa  perfect,  it  was  uor 
recognized.  However,  if  all  the  invalid  signs  were  deleted,  the 
nonexperts  were  slightly  sensitive  to  the  increased  covariations  between 
the  true  signs  and  homosexuality.  Further,  when  the  Chapmans  created  a 
series  of  massive  negative  covariations  between  the  invalid  signs  and  the 
symptoms,  the  nonexperts  reported  slightly  reduced,  rather  than  very 
strong,  positive  correlations.  True,  but  unexpected,  covariations  were 
unperceived  even  if  perfect  when  they  appeared  along  with  the  plausible* 
invalid  signs,  and  were  only  partially  recognised  when  they  appeared 
alone.  Invalid,  but  plausible,  covariations  were  perceived  even  if  the 
data  strongly  indicated  an  opposite  relation.  Theories  or  preconceptions 
of  »hat  “should**  covary  consistently  overwhelmed  daCa~driv©n 

rovuitationo . 

The  tasks  performed  by  the  Chapmans-  subjects  wera  considerably 
easier  than  the  tasks  af  naval  analysts  estimating  intentions.  The  data 
were  we  Unorganised,  clearly  and  concisely  presented  in  rapid  succession 
indicators  were  presented  at  the  time  as  symptoms,  there  were  fewer 
demands  on  memory,  etc .  Tot  their  subjects  cansiscenUy  failed  to  detect 
data-driven  covariations  and  repeatedly  perceived  nonexistent  but 
plausible  theory-driven  covariations*  this  bodes  ill  for  the  naval 
analysts.,  whose  tasks  are  far  less  clear  cut. 

.illusory  naya i  curve i at i nns ,  Two  clear  cases  of 

i  1  iusory^idr s elatl o«1’:vl iT "be  V«-I'fef  l  y  noted,  both  having  been  mentioned 
before*  The  perception  that  Soviet  t»«yy  presence  co-occurs  with  Third 
iter  id  leftist  coups  in  a  notion  that  ee.e»f,vgly  persists,  and  generates 
perceptions  of  none  vents  Soviet  fiavy  support  of  the  14  by  on  coup), 
despite  several  analysts  rejection  of  it  (s.g«,  iHsauteos 
aud  HcCOUncll,  19?9:  257-59). 

the  second  case  of  illusory  correlation  is  much  clearer  (but 
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perhaps  less  significant).  Petersen  (in  Diamukes  and  McConnell,  1979:  91) 
describes  "the  expansion  in  the  number  of  Soviet  diplomatic  visits  lin  the 
Indian  Ocean]  between  1967  and  1976"  as  "impressive."  In  fact,  Petersen's 
data  (p.  92)  show  a  negative  correlation  (  r  **  -.38)  between  year  and 
number  of  diplomatic  visits  by  the  Soviet  Navy  in  the  Indian  Ocean, 
Rather  than  an  "impressive  expansion"  in  visits  over  this  period  there  has 
been  a  contraction.  Tito  Indian  Ocean  is  the  only  region  where  the  trend 
in  number  of  visits  is  so  markedly  downturning;  in  other  oceans  the  number 
of  visits  has  been  constant  or  slightly  increasing.  It  is  thus  not 
surprising  that  Petersen  expected  a  positive  relationship. 

Psychologists  have  prooosed  four  different  reasons  for  the 
tendency  of  people  to  overestimate  the  degree  of  covariation  in 
theory-driven  associations  and  to  underestimate  the  covariation  in 
data-driven  associations  for  which  there  are  no  clear  cut  expectations. 
The  Chapmans  (1967,  1969)  explain  tue  occurrence  of  theory-driven  illusory 
correlation  in  terms  of  the  semantic,  associative  connections  between  the 
variables  which  are  mistakenly  perceived  as  correlated.  This  explanation 
is  similar  to  Tversky  and  Kahneman's  (1974)  availability  heuristic;  i.e., 
an  associative,  semantic  connection  is  readily  available  in  thought  and  is 
thus  suggestive  of  a  statistical  association. 

Taylor  and  Crocker  U979:  48)  offer  an  explanation  in  terms  of  the 
operations  of  the  theory  itself  (they  use  the  term  schema).  Theories  make 
some  types  of  evidence  more  available  and  influence  the  type  of  evidence 
the  person  is  likely  to  use  in  judging  covariations.  Specifically,  people 
r  arch  for  data  that  are  consistent  with  the  theory,  rather  than 
irrelevant  or  inconsistent  information.  People  consequently  over-rely  on 
the  number  of  “positive  hits"  (or  ++  occurrences)  which  confirm  the. 
theoretical  relationship  they  are  assessing.  Secondly,  the  judgment  of 
how  frequently  two  events  co-occur  could  be  based  on  the  associative  bond 
between  them,  as  Tversky  and  Kahneman  suggested.  When  the  association  is 
strong  the  person  U<  likely  to  conclude  that  the  events  ore  frequently 
paired.  Strong  associates  are  likely  to  seem  to  co-oecur  frequently. 

Hamilton  and  Si? ford  (1976)  offer  an  explanation  that  relies  on  a 
general  tendency  to  see  rare  events  as  co-occurring.  That  is,  events 
which  share  the  same  characteristic,  infrequency,  may  be  perceived  as 
being  associated,  and  thus  as  co-occurring.  Rather  than  a  semantic 
association  being  taken  tor  correlation,  they  suspect  a.  statistical 
characterise!,,  (infrequency)  as  giving  rise  to  an  association,  which  in 
turn  suggests  a  enr  talar  *<m»,  e»g»,  by  means  of  greater  availability  of 
associates, 

(tothtatt  OINK))  offers  a  fourth  possible  explanation  for  the 
occurrence  of  illusory  correlations  in  cases  when  two  events  are  split 
into  frequent  and  rare  groups*  in  this  ease*  even  when  no  covariation  at 
all  exists,  tue  number  of  cases  will  be  grossest  in  the  (frequent, 
requeue)  cell*  Simply  because  most  of  the  data  tail  into  this  one  cell, 
it  feesogee  the  m»t  envious  and  conspicuous,  and  people  vay  perceive  a 
covariation  merely  Ueaeoe  they  tend  to  attend  this  evil  msi-  closely* 
fiOtHhavr,  suggests  pair*  of  rare  events  and  of  very  eeeeoo  events  will  both 
rend  to  he  garceivr t  as  eo-oevurring.,  because  of  Cite  great  inequality  it. 
the  site  of  the  cells  in  the  four-fold  table*  The  **#•  case  becaucs  the 
ansi,  obvious  and  available  explanation  of  the  relationship  between  the 
events* 

Covariation  assessments  are  important  to  their  own  right,  but  also 
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because  they  are  essential  for  the  estimation  of  cause  and  effect 
relationships.  Correlation  does  not  imply  causation,  but,  as  will  be 
discussed  next,  causation  implies  correlation* 

Assessing  Causes  and  Effects 

Causation  is  an  idea  that  is  generally  used  because  it  is 
generally  useful. 

1),  H.  Fischer*  1970 

Assessing  causes  is  one  of  the  most  difficult  analytic  tasks. 
Scientific  methods  and  inferential  statistics  were  developed  in  part  to 
reach  sound  conclusions  about  causes.  Causal  reasoning  without  such  aids 
is  subject  to  bias  and  inaccuracy. 

Analysts  of  the  Soviet  Navy  often  describe  the  difficulty  of 
determining  causes  and  assessing  effects  in  their  field.  For  example, 
Booth  (SNR,  ch.  19)  summarizes  tie  discussion  on  whether  or  not  the  Soviet 
Navy's  forward  deployment  has  made  any  real  difference  in  Soviet  foreign 
policy.  He  wrote  (p,  368) 

.  .  «  this  question  could  not  be  easily  resolved  ...  It 
was  surrounded  by  an  inherent  obscurity  .  .  .  because  of  the 
elusiveness  of  the  cause-effect  relationship. 

In  a  similar  vein,  HceGwire  (SNR:  vii)  wrote: 

there  was  no  agreement  (among  naval  analysts)  on  the  impact 
of  the  Soviet  Navy’s  forward  deployment  on  Soviet  foreign 
policy,  and  to  what  extent  the  one  led  to  Che  other  ...  it 
was  difficult  to  identify  specific  instances  where  a  Soviet 
naval  presence  had  “caused"  particular  developments  or  had 
produced  shifts  in  Soviet  policy  ... 

A  fundamental  difficulty  is  that  causes  can  never  be  observed, 
they  are  always  inferred  from  either  (O  experiment  '(the" soundest  basis 
for  inference),  (2)  experience  and  observation  Can  imperfect  hut  often 
adequate  basis)*  or  C3)  theory  (often  an  unsounu  basis),  there  is  m 
inherent  gap  between  the  first  two  of  these  bases  and  the  third  which 
cannot  be  bridged  in  an  entirely  satisfactory  way.  People  think  in  terms 
of  a  theoretical  language  based  on  such  notions  as  causes,  forces, 
systems*  and  properties,  these  ace  attributes  or  relationships  with  no 
physical,  tangible  equivalents.  People  test  reality  with  covariations, 
operations,  and  measurements*  Science  "deals  with  this  basic  distinction 
by  separating  the  language  of  cheery  from  the  language  of  operations 
experimental  and  observational  methods),  “Conespts  in  the  one 
language  are  associated  with  those  in  the  other  merely  by  convention  or 
agreement  between  scientists**  wrote  one  scholar  of  causality  and  science 
(Blalock,  1974s  6). 

The  distinction  between  theory  and  operations  is  often  elusive, 
even  for  scientists*  There  is  a  very  strong  psychological  tendency  to 
think  and  reason  in  terms  of  causes  and  forces  as  if  these  were  real, 
rsfc&sr  than  axmfcal,  creations.  While  it  is  possible  to  find  operational 


evidunco  that  supports  a  causal  concept,  it  is  impossible  to  prove  a 
causal  theory;  causal  laws  can  never  be  demonstrated.  A  correct  causal 
law  will,  however,  allow  scientists  to  make  accurate  empirical 
predictions.  This  accuracy  is  the  basis  for  the  agreement  between 
scientists  which  Blalock  mentions.  But  the  correctness  of  prediction  does 
not  demonstrate  the  correctness  of  the  causal  theory.  Theories,  like 
puople,  are  often  right  for  the  wrong  reasons. 

Scientists  use  theories  for  the  sac*  reasons  the  rest  of  us  do, 
they  need  to  simplify  reality.  By  making  untestablc  assumptions,  a  few 
key  assumptions  can  be  indirectly  tested.  In  reality  no  two  events  or 
objects  are  ever  identical,  but  in  science  and  everyday  life  it  is 
necessary  to  act  as  though  events  can  be  repeated  and  objects  do  have 
properties  that  remain  constant  for  some  period.  Without  these  important, 
simple  assumptions  it  is  impossible  to  generalize  beyond  single,  unique 
events. 


Theoretical  models  of  reality  help  in  making  these  assumptions  so 
that  other  assumptions  about  causes  and  systems  can  be  tested.  An  ability 
to  predict  events  is  supporting  evidence  for  a  causal  theory  (but  not 
proof).  Predic:ion  is  tangible,  measurable,  and  "real**  while  "causes'*  are 
not;  the  two  should  not  be  confused. 


Causal  meaning.  What  is  generally  meant  by  "causality?" 
Scientists  require  three  things  in  tests  of  causal  laws.  Each  is 
necessary  and  none  alone  is  sufficient  as  evidence  for  causality  (Blalock, 
1974),  First,  if  X  is  believed  to  cause  Y,  a  correlation  must  exist 
between  them.  If  no  regular  correlation  exists,  ao  regular  causal 
relation  can  exist.  Second,  there  must  be  an  appropriate  temporal 
relationship,  i.e.,  X  must  occur  before  Y  occurs.  While  the  theoretical 
need  for  causes  to  precede  effects  is  obvious,  the  operational  problem  of 
determining  which  events  occur  first  has  uo  obvious  solutions  Ce,g.» 
unknown  aspects  of  Y  may  cause  X,  which  changes  at  the  same  time  changes 
in  Y  become  measurable  or  observable).  Third,  a  "presumptive  agency"  must 
Qxijt  to  connect  X  and  Y.  That  is,  some  operator  exists  which  generates  Y 
and  corresponds  to  X  and  which  is  organised  so  that  a  connection  between  X 
and  Y  can  be  separated  into  a  sequence  of  compatible  components  that  can 
be  reasonably  expected  to  overlap  (e£,  Fischer,  1970;  Iteise,  1975).  In 
some  respects,  the  third  condition  would  sees  to  be  sufficient  to  believe 
X  causes  Y,  However,  as  we  discuss  below,  the  human  mind  is  an 
extraordinarily  fertile  field  for  "presumptive  agencies"  -**  even  random 
events  can  be  readily  connected  in  the  mind,  Confirming  evidence  is 
easily  retrieved  from  memory  or  created  by  the  imagination  to  demonstrate 
causal  relations  which  do  not,  in  fact,  exist. 

Causal  errors.  In  this  section  we  discuss  major  psychological 
sources  sf  error  in  'causal  thinking.  People  nr#  imperfect  causal  analysts 
under  the  test  conditions;  even  scientists  ©ay  hypothesise  and  find 
nonexistent  causes  for  events*  For  example,  early  in  this  century  French 
scientists  discovered  a  now  lots  of  radiation,  the  N«K&y#  and  other 
scientists  confirmed  this  discovery.  The  radiation  was  entirely 
imaginary,  however,  the  seeming  evidence  for  it  was  totally  useless,  and 
the  compelling  concept  of  an  N-Hay  turned  out  to  be  completely  wrong 
(Klotc,  19B0). 

We  have  already  described  hew  biases  in  the  perception,  weighting. 


and  categorization  of  data  can  produce  what  are,  in  effect,  "illusory  data 
bases"  (Taylor  and  Crocker,  1979).  Even  with  accurate  data,  people 
perceive  illusory  correlations  and  may  fail  to  perceive  perfect  but 
unexpected  covariations.  In  other  words,  up  to  this  point,  before  any 
assessment  of  cause  and  effect  is  attempted,  we  have  noted  a  variety  of 
data  problems  which  would  bias  even  accurate  causal  assessments.  As  we 
will  see  however,  causal  estimation  itself  is  beset  with  problems,  which, 
along  with  those  that  precede  it,  can  severely  impair  causal  inferences. 

These  problems  cascade  as  more  information  is  integrated.  There 
are  more  opportunities  in  more  complex,  causal  estimates  for  bias  and 
error  to  occur.  It  becomes  more  difficult  to  determine  from  an  estimate 
itself  just  where  such  problems  started  or  ended  or  to  assess  the 
magnitude  of  bias  at  various  stages. 

Covariation  assessment  and  causal  estimation  serve  to  integrate 
and  summarize  data  and  facts  into  information  and  knowledge.  It  is 
difficult  to  separate  items  of  information  and  knowledge  into  the  various 
elements  and  processes  that  composed  them.  As  we  go  higher  in  the 
analytic  estimation  process  it  becomes  more  essential  to  examine  these 
components  and  processes  of  analysis  as  well  as  the  finished  products. 
However,  even  though  the  analytic  processes  and  ingredients  cannot  be 
entirely  deduced  from  finished  estimates,  an  outline  of  the  potential 
problems  with  the  "higher-order"  processes  (causal  estimation,  prediction, 
theory  testing)  will  help  both  the  analyst  and  the  estimate  consumer  to 
detect  vulnerabilities  and  errors. 

Causality  and  chance. 

Chance  is  a  word  void  of  sense;  nothing  can  ex.st  without  a 

cause. 


Voltaire,  A  Philosophical  Dictionary 

Chance  Is  perhaps  the  pseudonym  of  God  when  He  did  not  want 
to  sign. 

Aoatoie  France,  he  Jfacdln  d epicure 

There  it  a  strong  tendency  to  look  for  and  find  causal 
relationships  even  in  events  that  occur  together  by  chance.  Because 
people  are  highly  sensitive  to  the  +*  co-occurrences  and  relatively 
insensitive  to  and  instances  (which  invalidate  the  co-occurrence 
hypothesis),  people  tend  to  overestimate  the  causal  links  between  events 
which  are  randomly  connected* 

Several  factors  increase  the  likelihood  that  a  pair  of  events 
i&ich  randomly  co-occur  will  be  perceived  m  causally  linked.  First,  if  a 
strong  a  priori  theory  exists  to  link  the  events,  an  observer  will  be 
especially  alert  for  w  Instances,  which  ate  then  taken  as  evidence  in 
support  of  the  theory.  Even  more  fundamental  than  this  first  bias, 
however,  is  the  tendency  to  perceive  any  event,  object,  p*  cate  on  which 
v«  focus  our  attention  as  playing  a  causal  role,  third,  the  pairing  of  an 
intention  and  a  favorable  outcome  is  very  likely  to  lead  to  the  estimate 
that  the  actor  who  intended  the  outcome  actually  caused  the  outcome, 
although  the  favorable  out  cose  say  have  resulted  fros  chance.  The 


contingency  between  an  actor's  apparent  intentions  and  outcomes  is 
regarded  as  persuasive  evidence  of  causality.  This  perception  of 
cause-effect  is  greatly  strengthened  if  the  actor  is  also  seen  as  capable 
of  producing  the  desired  outcome.  The  result  Is  that  the  actor's  good 
fortune  will  be  misperceived  as  the  result  of  the  actor's  intentional  and 
successful  action,  fourth,  temporal  and  physical  contiguity  alone  can 
suggest  both  covariation  and  causality.  Actions  by  the  actor  with  a 
certain  pace  or  momentum  that  are  followed  by  events  with  similar  pace  or 
momentum  are  perceived  as  causally  related.  Events  which  co-occur  in 
proximity,  which  share  features  of  size,  shape  or  form,  temporal  pacing, 
and  duration,  etc.,  tend  to  be  perceived  as  causally  linked  and  the 
hypothesis  that  the  co-occurrence  was  coincidental  is  underweighced . 
Fifth,  observers  attribute  identical  "good'*  actions  to  the  dispositions, 
intentions,  and  motives  -Hf  liked  actors  but  attribute  them  to  the 
situation  and  environment  for  disliked  actors.  Similarly,  "bad"  actions 
by  liked  actors  ate  attributed  to  the  situation  and  environment,  but  the 
same  bad  actions  by  disliked  actors  are  perceived  as  reflecting 
intentions,  motives,  and  dispositions.  In  other  words,  disliked  actors 
intend  only  ted  actions,  and  perform  good  actions  only  when  forced  by 
circumstances  to  do  so.  Liked  actors  are  disposed  to  ”do  good*'  and  "do 
ted”  only  when  pressured  by  the  situation.  Preconceptions  about  the 
targets  of  observation  may  fill  in  causal  relationships  that  reflect  the 
preconceptions  more  than  any  causal  reality,  in  general,  observers 
attempting  to  estimate  the  causes  of  actions  greatly  overestimate  the 
impact  of  intentions,  dispositions,  and  motives,  and  underestimate  the 
role  of  situational,  environmental,  or  contextual  pressures.  Observers 
are  highly  likely  to  infer  intentions  from  actions,  and  to  deduce  that 
intentions  caused  actions,  when,  in  fact*  the  data  do  not  warrant  such 
conclusions. 

One  of  the  most  salient  differences  between  analysts  of  the  Soviet 
Navy  hinges  on  this  distinction.  One  group  of  analysts  perceives  the 
Soviet  Navy's  fotwata  deployment  and  efforts  at  naval  diplomacy  as 
dispositional i  as  actions  intended,  planned,  and  consistent  with  other 
Soviet  foreign  policy  behaviors  Ca.g,,  bismokes  and  HsConnell,  1979). 
Other  analysts  g,,  Hee&ui re ,  19?9)  see  the  forward  deployment  at  forced 
on  the  Soviet  Navy  by  situational  and  environmental  pressures,  namely  the 
strategic  threat  posed  to  Uussia  by  long-tsttgw  U,§*  Navy  weapons*  The 
forward  deployment  and  seek  of  the  subsequent  Soviet  naval  diplomacy  is 
viewed  as  caused  by  this  Western  threat,  net  by  Soviet  intentions  or 
dispositions,  Obviously,  the  first  group  of  analysts  will  tend  to 
attribute  much  mm  expansionist  it  and  aggressive  intentions  to  the  Soviet 
Navy,  while  the  latter  analysts  will  see  Soviet  intensions  as  being  ouch 
more  defensive  and  limited* 

Inhibitory  causes.  While  there  fs  a  psychological  tendency  to 
overestimate  cansai^eTacienships,  this  will  tend,  to  be  true  only  of 
positive  instances,  e  g*,  if  a,  then  n  (i.e,»  A  causes  or  facilitates  I* 
if  A  is  absent,  3  is  presumably  also  absent).  A  second  form  of  causal 
relation  is  ouch  harder  to  detect,  that  is,  when  A  inhibits  B  C if  A 
absent,  then  B  present;  or  if  A  present,  then  B  absent),  these  negative 
relations,  or  inhibitory  causes,  wilt  tend  to  he  underestimated. 

Consistent  with  the  analysis  of  negative  events  in  this  chapter, 
observers  have  difficulty  defecting  negative  causes,  i.c. ,  effect  B  occurs 
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only  a  the  absence  of  A,  and  never  in  A's  presence;  A  is  an  inhibitory 
factor  which  suppresses  B.  Because  A  snd  B  vary  inversely,  rather  than 
directly,  their  relationship  is  more  difficult  to  perceive  chan  facilitory 
causes  which  vary  positively  with  their  effects.  Inhibitory  causes  arc 
cases  of  what  cognitive  psychologists  term  '‘exclusive  disjunctions’*  (u.g., 
Posner,  1973:  76,  113).  People  find  such  concepts  more  difficult  to  code 
into  memory,  and  to  identify  correctly,  than  positive  concepts. 

The  role  of  inhibitory  causes  becomes  important  in  naval  analysis 
as  estimators  attempt  to  assess  such  things  as  deterrence  and  the  “denial" 
element  in  Soviet  motives  (see  Booth,  SNP:  365),  i.e.,  Soviet  efforts  to 
deny  Western  influence  in  Third  World  countries.  As  was  noted  above,  it 
is  quite  easy  to  fall  victim  to  a  “deterrence  trap,"  and  assume  that  a 
self-proclaimed  deterrent  is  the  cause  for  a  nonevent.  Similarly,  the 
Soviets  can  easily  claim  causal  credit  tor  a  lack  of  Western  influence  in 
a  region.  Such  theory-driven  inhibitory  relationships  may  be 
overestimated,  while  data-driven  inhibitory  relationships  may  be 
underestimated. 

Causality  and  representativeness. 

In  war  events  of  importance  are  the  result  of  trivial 

causes. 

Julius  Caesar,  l)e  Bello  Galileo 

A  person  may  use  the  representativeness  heuristic  when  seeking 
causal  explanations  of  events.  Causes  may  be  sought  which  resemble  the 
effects  observed.  Groat  causes  say  be  sought  to  explain  great  events, 
complex  causes  to  explain  complex  events,  etc.  Sethbart  and  b*ulero  U*??b) 
ter©  this  the  "profound  motive  fallacy,"  the  tendency  to  implicitly  match 
causes  snd  events.  Shweder  (197?)  uses  the  term  "magical  thinking  “  the 
belief  that  resemblance  implies  causality,  intuitive  perceptions  of  the 
causes  of  events  differ  depending  m  whether  the  consequences  are 
important  or  trivial*  Severe  and  bad  outcomes  are  attributed  to 
malevolent  motives,  while  large  good,  outcomes  are  attributed  to  good 
intentions  C kicked,  1974;  Putkbart  end  t'uleto,  l9fd>» 

foteseegftiiitv, 

—  i  . -  -i~-~  *  i 

kever  attribute  to  malice  that-  which  is  adequately  explained 

b#  stupidity, 

haul on* s  Saaot 

Rothbatt  and  Puiuro**  study  suggests  that  "foreseeability*  ’may 
play  an  important  role  in  causal  attribution*.  If  an  actor  it  perceived 
at  being  able  to  foresee  the  consequences  of  his  action1!?,  then  the  aesmt*® 
motives  are  perceived  as  more  profound  and  important  the  more  serious  the 
outcomes  of  the  actions*  Good  outcomes  suggest  good  motives  and  bad 
outcomes  bad  motives  if  the  actor  could  anticipate  his  actions* 
consequence*  . 

While  the  tendency  to  match  causes  and  effects  may  be  strong,  it 
is  not  overwhelming,  however,  it  does  lead  to  an  overeat isation  that 
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representative  causes  are  responsible  for  effects  and  an  underestimation 
of  the  importance  of  loos  representative  but  valid  causes*  In  particular, 
a  case  of  the  "profound  motive  fallacy"  seems  to  occur  in  analyses  of 
current  Soviet  foreign  activity,  including  naval  behavior. 

Analysts  of  Soviet  foreign  policy  motives  have  long  realized  that 
Soviet  or  U.S.  actions  could  lead  to  nuclear  war*  It  was  often  argued 
that  neither  side  wanted  such  a  war  and  chat  it  could  only  come  about 
through  a  miscalculation;  neither  would  ever  cake  actions  that  could 
explicitly  lead  to  nuclear  war.  In  effect,  the  real  possibility  of 
nuclear  war  was  explained  by  the  belief  chat  neither  side  wanted  it  but 
neither  side  could  foresee  how  it  might  occur,  or  predict.it,  or  always  be 
sure  of  avoiding  it.  this  appreciation  of  Soviet  .and  Western  outlooks  was 
fairly  common  among  Western  analysts  as  long  Soviet  strategic 
capabilities  were  inferior  to  these  of  the  United  States,  This  outlook 
seems  to  have  been  a  taajor  contributor  to  the  Western  mirror-image 
perceptions  of  the  West  and  the  Soviets;  that  the  Soviets,  like  U,$, 
leaders,  did  not  believe  that  nuclear  wars  could  bo  won,  and  that  nuclear 
war  deterrei  ce,  rather  than  its  conduct,  was  of  the  greatest  importance. 

As  the  Soviets  first  matched  and  then  seemed  to  surpass  Western 
strategic  systems  levels,  data  accumulated  which  suggested  the  Soviets  did 
not  perceive  nuclear  war  as  a  hopeless  situation,  and  that  they  were 
perhaps  explicitly  considering  strategies  to  fight  and  “win"  nuclear  war. 
At  any  rate,  their  military  planning  and  doctrine  included  much  greater 
attention  to  the  conduce  and  outcome  of  nuclear  war  than  was  present  in 
tfysttmi  strategy,  and  much  less  concern  with  the  deterrent  aspects  of 
nuclear  systems, 

fliis  Soviet  "varf igHUng"  outlook  implied  foresight;  i , « . ,  the 
Soviets  had  anticipated  the  wartime  implications  of  nuclear  and 

were  designing  their  ewe.  m%  Just  for  a  peacetime  deterrence  mission  (if 
at  all)  but  also  Cor  perhaps  exclusively)  for  a  watfi^htiug  aAsaisnu 
this  Varslghtiftg*5  &utihuti$«  m>&m  also  to  have  leg  v, 
analysts  to  a  "profound  motive'*  attribution  if.  the  $»v4ei  .  ■ 
foresee  nug.lc.at  war  t«  the  extent  of  planning  f@r  it,  they  must  huv>  •. 
profound  motive  for  their  Hehavis?  with  respect  to  these  profound 
e@use$uences ,  XI  they  eould  anticipate  such  a  war,  even  plan  Set  it,,  the/ 
must  intend  in  suae  way  to  use  nueh  war  prepa ration,  if  -mt$  an  a  threat 
to  sain  their  ebjettives*  the  Soviets  were  shut  seen  it  mw  willing  tt 
intentionally  manipulate  the  threat  of  a»e)#aw  war  to  get  their  way* 
because  they  were  seen  as  foreseeing  nuclear  war, 

A  Soviet  willingness  t$  prepare  t.m  nueiear  war  (rather  thaa.t#. 
merely  prepare  deterrent  systems,  vMnh  has  been  the  Western  eoMse*  at 
least  until  recently),  obviously  does  n@t  neeeesarijy  imply  that  the 
Soviets  are  wilSiag  to  riah  eugiear  war,  et  to  use  strategic  systems  m 
instruments  of  psliclfil  hlaekmaii  or  eeeroien.  $&m  wtssera  analysts 
see*  t#  believe,  however*  that  this  is  the  mm,  C.»*§  *  Pipes,  1$??)*  It 
seems  at  least  possible  that,  these  analysts  are  ittgibut.in§  profound 
wstlvgs  (willingness  to  risk  war  m  use  angieer  hiaekasaill  to  ae@#oot  lot 
pfpf effects  (preparing  fa*  war)  and  Soviet  foresight  (planning  f«r 
war)*  Sertalnly  the  sost  ptsfsusd  form  si  defense  is  defense  sram  nuglear 
attack*  Soviet  efforts  to  that  effect  se«&  to  have  led  some  Kestem 
analysts  to  attribute  the  Soviets  with  amt  I  res  mm  profound  than  simply 
defense*  !♦«.,  with  motives  that  are  offensive  as  «#eli*  the  fact  that  the 
Soviets  are  unwilling  to  see  Western  political  leaders  as  forsaking  the 
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threat  of  nuclear  vat  is  underweighterf,  while  the  Soviet's  planning  for 
nuclear  war  is  overweighted  in  assessing  the  causes  of  Soviet  behavior. 
One  consequence  of  this  profound  motive  fallacy"  is  that  thu  forward 
deployment  of  the  Soviet  Navy  and  Its  use  in  diplomacy  is  perceived  by 
some  Western  analysts  as  suggesting  the  Soviets  are  willing  to  risk 
nuclear  war  in  confrontations  with  the  U.S.  Navy  (see  HccGwirs,  SND, 
prologue  for  a  similar  conclusion). 

Magical  thinking.  Xn  "magical  thinking"  ^he  salient  features  of 
effects  are  used  as  indices  to  guide  the  search  for  causes.  Those 
events"  that  share  the  features  of  the  effects  (or  have  directly  opposite 
features)  are  perceived  as  the  most  likely  causes. 

A  stress  on  military  or  naval  doctrine  as  the  cause  of  naval 
actions,  may  be  seen  as,  in  part,  magical  thinking.  Doctrine  shares  taaay 
of  the  features  of  naval  actions  and  thus  forms  a  ready  explanation  of 
naval  behavior,  however,  doctrine  is  ambiguous  and  encompassing,,  and 
often  $ei ^contradictory.  Any  naval  action  could  probably  be  plausibly 
explained  by  some  doctrinal  "principle."  Some  causal  factors  other  than 
doctrine  must  dictate  which  part  of  doctrine  is  operative  in  leading  to 
suy  given  naval  behavior. 

MccGwire  emphasizes  Soviet  naval  construction  as  both  eausn  and 
effect  of  Soviet  naval  behavior.  For  example,  he  writes  (SND;  1?6): 

AH  interpretations  of  Soviet  policy  must  involve  some 
element  of  conjecture  .  ♦  .  analysts  of  Soviet  naval  policy 
are  unusually  fortunate  in  having  available  a  range  ©f 
■  specialised  and  reasonably  concrete  data  from  which  to 
derive,  and  against  which  to  test  their  hypotheses ,  by  its 
very  nature,  the  significant  evidence  comprises  larg#-. 
discrete  items  (warships)  *.  *  .  the  nu@b«r  and 
character issics  .  »  *  ©f  ships  reflect  the  ml*  of 
wperationa)  requirvstoss  .  *  *  Operational  activity  • 
reflects  estaoi  ished  tactical  concepts  and  ©sssssiasnt*  vf 
thrusts  «  •  •  Patterns  el  tel  lees  daeisions  on 

the  at  available  capability  *  •  .  all  this 

evidm*-* ' £4*  fee  cvnhined  .  *  *  (to!  providti  a  reasonably  • 

clear  ©at  .tins  ©l  saw)  and 

this  kitty'.  &£©$  magical  thinking  to  -the  j&sgrg-e  that  it 
tte  fls&l  Milky  ®s  savai  vessels  and  tfefc  «* 

d#ct#i@u§  ani  hehtviors*  That  is,  particular  a&val  4®  •  »$* 

■#%ii fi.s-  #11  p-ara<astsgr#  of  esaetrueitaa  Cta^iesterid^  and 

*cn?o*&Se  -lisfis#  wia#  plsy  -thst*-  rules),  tdf  4*  th#  si 

4  ship  isiilly  fiss.4  Its  f#i&AU!4i  paraststets  * 

availability  ©f  &§%$  £#&  |fe§&ly  ^fesu,i  tha  .raitus  sf  vaait4>',. 

ships  Tcipond  is  -design  liaise  aid  s^fclsstsHMar •  th*fc  -sis  dimply 
.  'ft#*#!.,  Mi  isviut  Ship#  o#,y  uu44c£&he  fuel.  oversea,  tullyl 

•  which  they  #te  3il~fS$*e.4»  ahlpt'aftd  ship 

nut  siap-iy  rcilvct  thei  t  ■  i*ee<2l#ie  rjws  enukea.  or 

Heavies  «ot  vKpliriily  imply  #t.«vrvi*c>.  in  tact.  h* 

rfeptASSdly  ktftfVS  thst  h#  ct*sid$r-s  #04c«abiue£vari4fcA  Sifto#  e?  pvidv.ncn 
'  («ha£  the  fc&Sps  were  built  •a.'d  used  ice,  wfeitt  the  snip#  SeukC  attempt  ># 
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do)  in  hit?  estimates  of  whet  the  Soviets  plan  to  do  with  their  naval 
forces.  Nevertheless,  a  heavy  emphasis  on  ship  and  system  features  may 
predispose  the  hardware  analyst  more  than  others  to  expect  that  the  causes 
of  Soviet  ship  construction  will  resemble  the  ship3,  and  that  the  effects 
of  Soviet  construction  will  resemble  the  ships'  capabilities.  The 
hardware  analyst  may  tend  to  underestimate  the  degree  to  which  Soviet  ship 
construction  responds  to  nonnaval  pressures,  or  the  degree  to  which  Soviet 
ships  may  undertake  missions  or  have  effects  for  which  they  were  not 
designed . 


Capabilities  and  intentions.  MceCwire  himself  describes  a  similar 
problem  (SNt),  prologue):  that  the  close  examination  of  r’»e  evolution  and 
character  of  Soviet  capabilities  may  lead  the  analyst  to  suggest  that 
Soviet  inteittlons  follow  from  (or  resemble)  capabilities.'  The  consequence 
is  that  the  anrlyst  may  calculate  the  worst  that  the  Soviets  could  do  and 
reason  that  this  is  also  what  they  wi 1 1  do.  An  equally  misguided  tendency 
is  to  estimate  the  limits  of  Soviet  capabilities  and  then  assume  the 
Soviet  Navy  would  not  undertake  missions  that  exceed  those  apparent 
limits.  Ait  assumption  that  intentions  simply  resemble  capabilities  is  the 
most  dangerous  manitestaciem  of  the  representativeness  heuristic  in  naval 
analysis  but  one  which  seems  quite  rate  among  the  Soviet  nav3l  estimates 
sampled. 

However,  because  the  conclusion  that  intentions  will  resemble 
capabilities  is  so  dangerous,  naval  analysts  should  be  especially  alert  to 
this  bias,  particularly  in  mare  subtle  shapes.  For  example,  an  analysis 
that  Soviet  ships  are  especially  limited  with  respect  to  some  mission 
(e.g>  ,  sea  control,  of*  Friedman,  ffFSff?  should  not  be  taken  to 
automatically  imply  that  the  Soviet  Navy  would  never  attempt  chat  mission, 
Prior  to  Pearl  Harbor*  for  example*  t|.§»  naval  analysts  reasoned  that, 
because  it  was  ill-suited  for  sea  control,  the  Japanese  Navy  would  not 
undertake  massive  offensive  operations  rar  from  home  waters,  On  the  other 
hand,  a  particularly  strong  Soviet  capability  should  not  be  taken  alone  as 
evidence  that  the  Soviets  planned  or  intended  to  use  that  capability*  The 
Soviets*  submarine  strength  provides  them  a  strong  capability  to  interfere 
with  western  sea  lines  of  eesanBicatisa,  but  it  is  questionable  whether 
this  mission  has  a.  very  high  priority  in  the  Soviet  Navy  (see,  e.g,  STS 
tws  diseumoh  of  the  pros  and  gen*  m  this  issue).  Analysts  should  avoid 
letting  gapabilisies  aioue  suggest  causal  schemas  for  Soviet  iateatious, 
oy  aa-sumiog  latent  ions  must  resesMe  capabilities. 

SllSlLJM tgh  Mgff#.»  Two  retest  studies  by  Shaklee  and  fisehhsff 
sufftse  -that'  peuple  analyse  a  situation  uatll  they  have 
identified  a  set  of  sufficient  causes  *  dither  possible  causes  are 

thereupon  igaufed  e#  dismissed,  Fe.bpie  tee*  to  believe  that  multicausal 
siteMlsss  are  unlikely  re  ectuc,  khen  they  knew  or  believe  one  cause  it 
preseats  they  believe  ether  causes  are  absent,  Potentially  a&bfgese# 
isliksttit!  .are  teeif-sd  as  uaaahigueus  single  causal  ones,  Shsklee 
and  fis-ebbsif  I-abei  these  t«nde«cie#  the  *psiuei pic  of 

5 II  »5*n 

problests  have  eaey“t&'“uhdetstaad  weeag 

answer e.  . 

§€*§$ <seatit*«  aisquote  of  u.  L.  Hcoekea 
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People  seem  to  feel  quite  comfortable  with  the  first  causal 
explanation  that  is  congruent  with  their  observations.  There  may  be  very 
little  or  no  searching  or  testing  beyond  the  first  monocausa’  hypothesis 
that  fits  the  data.  Since  the  first  plausible  cause  may  not  be  the  best 
explanation,  Shaklee  and  Fischhof f  (197?)  observed,  "the  true  cause  way 
never  be  evaluated  because  the  question  is  closed  prematurely.'' 

SJhaklee  and  Fischhof f  (1979)  tested  whether  people  tend  to  use  a 
"parallel  search"  (i.e.,  examine  information  on  all  possible  causes  before 
making  causal  judgments),  "serial  search"  (examine  one  possible  cause 
after  another),  or  a  “truncated  search"  (examine  one  cause  without 
considering  othc  '  They  found  people  tend  to  investigate  only  the  first 
cause  they  bel  „  to  be  acting,  i.e.,  they  truncate  the  search  among 
possible  causes  after  the  first  plausible  one  is  found.  Once  an  event 
could  be  plausibly  explained,  there  was  very  little  investigation  of  other 
possible  causes. 

Minimal  causation  is  consistent  with  a  belief  that  facts  and 
events  fit  only  one  theory.  Since  people  may  select  first  the  cause  that 
is  most  available  or  most  representative  of  effect,  other  causes  less 
available  or  representative  will  tend  to  escape  attention,  because  the 
first  plausible  cause  is  not  likely  in  general  to  be  the  beat  causal 
explanation,  people  will  tend  to  be  overconfident  regarding  the  accuracy 
of  their  causal  theories.  That  is,  people  will  tend  to  believe  they  have 
settled  on,  not  just  the  first,  but  the  best  explanation. 

Causal  hydra u l igs ,  The  tendency  to  assume  that  events  can  be 
explained  by  a  single  cause  and  to  seek  the  first  plausible  causal 
explanation  leads  to  a  simple  hydraulic  notion  of  causality*  i.e*,  a 
belief  th«U  causes  compensate  for  and  compete  with  each  other  in  producing 
for  effects.  That  Is,  analysts  way  believe  that  if  sgrong  political 
factors  a? ,  causing  a  Sevier  behavior,  strong  wilitacy  or  naval  factors 
eansttit  also  fee  causing  that  behavior.  Alternatively,  an  analyst  eight 
perceive  a  strong  causal  inf  luence  by  the  Soviet  ftevy  m  the  actions  of 
thft  <13*  tfcwjr  and  not  perceive  very  strong  U»S,  causal  ia*  loanee*  aetiag 
aa  the  !).§*  if&yy  at  the  same  ztm* 

For  axaeple,  a  papular  tsshaique  in  foreign  policy  anal  ye  is  is  i© 
-sxanifis  a#  the  product  of  toroiusrotlfc  «eipsti£i«»§  toman 
agencies  and  ifttstesss  in  a  nation  is  §.,  ShF,  eto*  ©st#n  these 
bureaucratic  attar*  are  seen  as  necessarily  tanpeelngi  w&te  for  the  8avy 
S  spiles  less  for  the  Amy ;  wore  guns  tiaai  lets  hotter*  Fur  example* 
Varner  (S||Pi  79}  wrote  of  Soviet  weapaas  acquisition* 

The  preteS'S  is  fundament  ally  It  is  pasweated 
with  pulling  and  hauling  over  roles*  jtiasiaas,  budgetary 
priorities.,  and  many  ether  institutional  consider ati-sga* 

A  here  sophisticated  nut  look  aeknnwSed.ges  the  of 
rational  ^tgiaaetlng  and  pni$fiy'a*taks«§5  the  Atny  tiUNf  may  eeatpete  fir 
respective  shares  but  so  in  a  wanner  isst  leads  t«  sars  far  toth*  A- 
mac  ion  way  increase  pnaducti  vity  sw  that  there  are  ware  guns  and  mere 
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butter,  even  though  military  and  civilian  sectors  continue  to  compete.  As 
game  theorists  have  long  ago  noted,  a  zero-sum  game  (strict  competition) 
admits  only  one  motive*,  while  nonzero  sum  games  allow  players  to  set  with 
a  variety  of  mixed  motives. 

Can?  il  hydraulics  imply  that  if  an  analyst  perceives  a  factor  to 
be  present  which  is  known  (or  strongly  believed)  to  be  sufficient  cause 
for  some  action,  then  other  factors  are  assumed  by  cite  analyst  to  be 
nonexistent  or  relatively  unimportant,  this  leads  to  the  fallacious 
belief  that,  if  A  can  be  shown  to  have  caused  tt,  this  somehow  proves  that 
C  did  not  cause  B.  the  presence  of  A  is  then  taken  as  evidence  for  the 
absence  of  C.  Nano  ©£  the  naval  analysts  sampled  second  to  adhere  to  this 
fallacious  belief,  to  the  contrary,  Mainland  (SUDs  1$?),  ibr  example, 
notea  that 

Ue  are  forced  to  infer  antecedents  fro®  their  observable 
consequences  »•*  remembering  all  the  while  that  any  action 
can,  and  most  actions  probably  do,  have  more  chan  one 
antecedent. 

Its  operation  in  the  larger  context  of  Soviet  analysis  is  not  unusual, 
however,  Far  example,  some  who  argue  the  Soviet  Union  is  motivated  by  a 
desire  to  obtain  military  superiority  seem  t©  beiisee-this  implies  that 
the  Soviets  teuid  not  also  be  motivated  by  a  desire  for  detente  with  th^ 
United  States, 

Paeilm.anya  mis^tided  parsimony,  and  Indjsgr Iminnat  pluralism, 
if  it’s*  worth  doing,  it *s  worth  overdoing, 

Roger's  Blessing 

Mf  can  be  Held  true  g§m«s  what  may,  if  we  make 

drastic  enough  adjustment®  elsewhere  in  the  ayste®. 

«.  v.  d.  ijuiue, 

fevui  analysts  s-etastsaally  aofgvst  that  §&§  $f.  their  number  has 
an  overly  simple  causal  @§d$l  of  Soviet  naval  behavior,  f«$j  , 

Mainland  {g®®*  1H)  wrote  the  fsi lowing  $f  Kdt&wisre**  analysis  of  levies 

forward  deployment; * 

itest  of  what  he  says  is  fight,  §•§««'  of'  what  he  says*  §n  tbs 
nthsf  hand,  is  so  right  that  it  %.%  wrong,  Soviet  “say&l 
policy  and  practice  are  in  ta€t  nredaninintiy  reactive  in 
eharast at  and  defensive  su  orientation,  In 
afgunant.  bowovet,  they  am  only  that  *•  the  imperatives  of 
strategic  defense  are  dspiitel  as  and  total i# 

pervasive,  and  the  invieta  are  clearly  dsnied  itaadu®  of 
ihitiattve,  Strategic  shstemss  is  the- reason  ief„  and 
■  explanation  of,  ail  -that  they  da. 

This  $$  detar'-niats®  IslaS  gar _.  ejtesl Iqum.  and  sing  la -fact  or 
explanations  of  this  nat-vie  especially  explanations  OS 
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the  behavior  of  organizations  as  large  and  multifaceted  as 
the  Sovie*-  Navy  —  require  a  considerable  amount  of  direct 
empirical  evidence  in  their  support  before  they  can  be 
accepted.  That  kind  of  evidence  simply  does  not  exist  in 
this  case. 

Mainland's  critique  suggests  a  common  assumption  in  naval  analysis 
and  political  science,  namely  that  the  rule  of  Occam's  Razor  does  not 
apply.  That  is,  the  notion  of  parsimony  per  se,  is  not  highly  valued  m 
explanations,  and  instead  efforts  are  expended  to  account  for  everything, 
rather  than  to  account  for  most  things,  Weinland  seemingly  argues  that 
all  Soviet  actions  must  be  explained.  He  writes,  for  example  (p.  295) 

o  .  .  the  evidence  does  support  the  interpretation  of  Soviet 
naval  policy  and  practice  as  predominantly  reactive  in 
character,  and  defensive  in  orientation.  Some  of  their 
actions,  however,  require  other  explanations  .  .  . 

He  challenges  MccGwire's  parsimonious  strategic  defense  hypothesis  [which 
may  be  reductionistic  but  is  not  deterministic]  because  it  fails  to  cover 
each  Soviet  naval  move.  A  requirement  to  explain  all  rather  than  most  is 
absolutely  deterministic:  it  implies  there  exists  £  cause  for  every 
Soviet  action  and  leaves  no  room  for  chance,  luck,  random  factors,  or 
causes  yet  undetermined. 

Weinland  makes  it  clear  that  he  does  not  expect  every  Soviet  move 
to  be  fully  explained,  but  he  seems  to  argue  that  this  should  be  the 
ultimate  objective.  He  also  notes  that  the  causes  of  Soviet  naval  moves 
are  not  always  Soviet,  that  Western  and  international  factors  play  a  role 
in  causing  Soviet  policy  and  practice. 

The  widespread  notion  that  all  Soviet  naval  actions  should  be 
explained,  and  that  different  causes,  or  combinations  of  causes,  could  be 
found  for  every  Soviet  event,  might  lead  to  a  more  sophisticated  form  of 
"minimal  causation."  That  is,  a  plausible  cause  is  applied  to  each 
different  event,  until  that  cause  no  longer  seems  plausible,  at  which 
point  a  new,  plausible  cause  is  selected,  and  so  forth,  until  every  event 
is  explained. 

The  effort  to  explain  every  Soviet  event  leads  to  overfitting  the 
data;  i.e.,  the  ability  to  tit  an  explanation  to  all  events  under 
examination.  With  a  sufficiently  large  number  of  explanatory  variables  , 
any  set  of  events  can  be  explained  to  whatever  degree  of  precision  is 
desired.  The  consequence  however,  is  "shrinkage,"  the  inability  to 
accurately  predict  future  events.  A  parsimonious  explanation  may  not  bo  a 
perfect  fit,  but  is  more  likely  than  all-encompassing  explanations  to  hold 
true  in  future  cases.  Fischer  (1970)  terms  the  multiplication  of  causal 
components  "indiscriminate  pluralism"  and  notes  that,  without  a  specific 
means  of  weighting  causes,  no  clear  interpretations  of  effecca  ar$ 
possible.  Neither,  we  would  add,  is  accurate  prediction  possible. 

Calling  a  cause  a  cause.  Fischer  (1970)  has  also  noted  the 
tendency  to  use  linguistic,  subterfuges  to  introduce  multiple  causes 
without  labeling  them  as  such.  The  terms  "antecedents,"  "factors,"  and 
"rules"  are  some  common  cover  words  for  causes.  It  is  not  clear  why 
analysts  avoid  tho  term  "causes  "  but  readily  cleave  to  "rules"  or 


"factors."  What  does  seem  clear  is  that,  as  used  by  analysts,  ‘‘rules**  or 
"factors"  differ  little  from  causes,  and  the  use  of  the  former  terms  tends 
only  to  complicate  issues.  For  example,  Dismukns  and  McConnell  (1979; 
2  7b)  have  the  following  to  say  about  their  “rules'*  of  Soviet  naval 
diplomacy: 

The  rules  are  .  .  .  explicitly  not  meant  to  provide  detailed 
predictions  of  superpower  action  in  future  Third  World 
crises.  By  identifying  regularities  in  past  behavior,  and 
hence  reducing  uncertainty  about  future  behavior,  the  rules 
can  aid  the  policy-maker  in  diagnosing  the  situation  and 
making  contingent  forecasts  .  .  .  the  rules  provide  a  model 
of  behavior  against  which  the  superpowers1  actual  behavior 
can  be  assessed. 

How  the  rules  can  help  make  contingent  forecasts  without  making  detailed 
predictions  is  not  clear,  nor  is  it  clear  how  a  model  of  future  behavior 
differs  from  a  causal  model.  It  seems  possible  to  speak  of  "causes  * 
without  foresaking  one's  belief  in  complex  cause-effect  relationships. 

Fundamental  attribution  error. 


It  must  be  remembered  that,  among  all  changes,  the  nature  of 
man  remains  much  the  same;  the  personal  equation,  though 
uncertain  in  quantity  and  quality  in  the  particular 
instance,  is  sure  always  to  be  found. 

Alfred  T.  Mahan 

People  tend  to  estimate  the  causes  of  an  actor's  behavior  as 
predominately  or  exclusively  motivational  and  dispositional;  i.o.,  as  due 
to  the  actor.  On  the  other  hand,  they  tend  to  underestimate  the  impact  of 
the  environmental  or  situational  pressures  as  causes  of  behavior. 
Psychologists  have  labeled  these  tendencies  the  “fundamental  attribution 
error"  (Ross,  1977), 

One  explanation  of  this  bias  is  due  to  perceptual  salience, 
observers  tend  to  focus  on  the  actor  rather  than  on  aspects  of  the 
situation.  Such  "perceptual  focusing"  tends  to  produce  causal 
attributions;  whatever  or  whoever  we  focus  our  attention  on  becomes  more 
apt  to  be  perceived  as  causing  the  events  we  see  (Duval  and  Hensley,  19?b; 
Storms,  1973;  Taylor  and  Fiske,  1975).  This  implies  that  observers,  who 
are  focusing  on  the  actor  should  perceive  the  actor  (or  rather  the  actor's 
dispositions  and  motives)  m  causing  the  actor's  behavior,  whereas  the 
actor,  who  is  focusing  on  the  situation  and  environment,  should  perceive 
environmental  pressures  as  causing  his  behavior.  This  is,  in  fact,  what 
psychological  studies  repeatedly  find;  aators  attribute  their  own 
behavior  to  the  environment  while  observers  attribute  the  same  behavior  to 
the  actor  (Jones  and  Nisbett*  1971), 

The  implication  of  the  fundamental  attribution  terror  is  that 
estimators  may  coo  readily  infer  broad  personal  dispositions  and  expect 
consistency  and  predictability  in  behavior  across  a  wide  variety  of 
situations  and  contexts.  There  xs  a  tendency  to  draw  hasty  conclusions 
about  dispositions  while  overlooking  relevant  environmental  forces  and 
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constraints.  Jervis  (1968)  suggests  several  ways  this  tendency  may  lead 
to  misperceptions  of  intentions:  estimators  may  see  the  behavior  of 
others  as  more  centralized,  disciplined,  and  coordinated  than  it  is;  and 
may  tend  to  perceive  the  position  of  a  state's  Foreign  Office  [or  Navy]  as 
the  position  of  the  state. 

Naval  analysts  who  argue  that  Soviet  naval  peacetime  and  crisis 
behavior  is  largely  determined  by  a  long-term  Soviet  foreign  policy  plan 
may  be  victims  of  the  fundamental  attribution  error.  Similarly,  those 
analysts  who  see  Soviet  naval  evolution  as  the  exclusive  handiwork  of 
Admiral  Gorshkov  are  probably  overestimating  that  already  formidable 
commander , 

Jervis  (1968)  also  notes  that  when  states  interact,  one  government 
may  overestimate  the  degree  to  which  some  desired  behavior  by  the  second 
state  is  due  to  the  influence  of  the  first,  and  will  overestimate  the 
degree  to  which  undesired  behavior  by  the  other  state  is  due  to  internal 
forces.  That  is,  estimators  may  generally  see  ocher  states  as  behaving 
negatively  for  dispositional  reasons  and  behaving  positively  because  of 
influence  exerted  by  the  estimators*  own  government.  In  this  latter  event 
the  estimator  overemphasizes  his  own  government's  influence  in  bringing 
about  the  positive  behavior.  These  tendencies  have  been  noted  in 
psychological  research.  Taylor  and  Koivumki  (1976)  found  that  people  are 
perceived  as  the  cause  of  positive,  desired  outcomes  while  situational 
factors  are  regarded  as  causing  negative  outcomes.  They  labeled  this  the 
“positivity  effect.-  Snyder,  Stephan,  and  Eosenfield  (1976)  found  an 
egotistic  tendency  to  make  attributions  that  put  oneself  in  the  best 
possible  light,  attributing  good  outcomes  to  one's  own  skills  while  bad 
outcomes  are  attributed  externally. 

This  tendency  uas  been  repeatedly  exploited  by  the  Soviets, 
according  to  MccGwire  (e.g.,  Sffl:  3),  through  what  he  terms  the  "Western 
amplifier”  effect  (p.  <•)«  KccOwi re  argues  that  Western  observers  have 
overestimated  the  extent  to  which  the  Soviet  Navy  has  deterred  the  U,S, 
Navy  during  superpower  crises  in  the  Middle  Bast.  In  effect,  he  accuses 
the  observers  of  falling  victim  to  the  "deterrence  trap”  described  above, 
i»e.,  of  believing  that  the  Soviet  naval  presence  caused  a  nenevgnt  (i.e,f 
U.S,  nonintervention),  and  ignoring  the  situational  factors  that  also 
influenced  U.S.  behavior. 

From  the  Western  perspective,  attributing  the  course  of  Middle 
Eastern  crises  to  the  Soviets  (rather  than  to  U.S.  and  Middle  Eastern 
dispositions)  ussy  be  ones  means  of  Justifying  the  negative  aspects  of  these 
crises  (e.g*,  the  oil  embargo  and  subsequent  energy  and  financial  crises). 
The  egotistic  tendency  would  lead  Western  observers  to  look  for  external 
causes  for  these  negative  outcomes  for  the  West  and  the  Soviets'  presence 
provides  a  convenient  explanation.  In  turn,  the  Soviets  have  exploited 
these  Western  perceptions  to  advertise  their  influence  over  the  U.S*  Navy, 
and  their  ability  to  protect  Third  World  cl lento*  Several  naval  analysts 
seem  to  give  too  little  attention  to  t!»S*  forces  as  &  counter  to  Soviet 
intervention  in  crises  and  too  much  to  Soviet  forces  as  a  counter  to  U.S. 
intervention.  After  all,  it  was  the  Soviet  Union  that  explicitly 
threatened  to  intervene  In  the  1973  crisis  and  the  United  States  that 
forestalled  their  intervention,  both  directly*  through  a  world-wide 
military  alert*  and  indirectly,  by  forcing  Israel  to  moderate  its 
actions . 

the  iuodaacatal  attribution  error  can  also  be  noted  in  efforts  by 
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naval  analysts  to  explain  actions  which  are  largely  just  naval  as  serving 
Soviet  foreign  policy  ends.  For  example,  analysts  have  elaborated 
political  links  between  a  Soviet  naval  exercise  and  the  "Cod  War."  They 
have  explained  Soviet  port  visits  in  the  Indian  Ocean  as  almost  wholly 
diplomatic  (despite  the  limited  diplomatic  character  of  Soviet  actions  in 
that  region).  They  have  attributed  Soviet  naval  activities  to 
inf iuence-buiidlng  despite  numerous  severe  setbacks  in  Soviet  foreign 
affairs  (e.g.,  Indonesia,  Egypt,  Somalia)  which  reflect  a  largely  negative 
diplomatic  balance  sheet,  and  a  need  for  foreign  bases  that  goes  beyond 
influence  building. 

Assessing  dispositional  causes.  Given  a  tendency  to  overestimate 
dispositional  causes  and  to  underestimate  situational  causes,  especially 
when  unliked  actors  have  performed  "bad"  deeds,  what  steps  might  obervors 
take  to  make  more  realistic  estimates?  Two  skills  are  necessary  at  the 
outset:  the  ability  to  detect  covariations  end  to  estimate  their 
strengths.  Unless  the  observer  can  estimate  covariations  fairly 
accurately  (that  is,,  weigh  all  four  cells  in  the  present-absent  table,  not 
just  the  +*  cell),  the  other  steps  outlined  below  are  of  little  value.  In 
fact,  if  based  on  faulty  estimates  of  covariations,  the  steps  below  way  be 
seriously  misleading. 

The  initial  requirement  of  causal  evaluation  is  to  determine  that 
the  suspected  cause  reliably  covaries  with  its  effect.  This  assessment 
can  and  should  be  done  retrospectively,  as  well  as  for  data  which  is 
obtained  in  the  future.  That  is,  all  relevant  past  events  can  be 
reexamined  to  determine  if  the  suspected  cause  was  reliably  related  to 
events.  The  caveats  noted  above  for  covariation  assessment,  e.g.,  the 
possibility  of  illusory  correlation  perception,  should  lead  the  analyst  to 
adopt  a  data-driven  rather  than  theory-driven  approach.  Secondly,  the 
difficulty  in  perceiving  negative  covariations  should  lead  the  analyst  to 
take  pains  to  explicitly  hypothesise  inhibitory  causes  and  search  through 
the  data  for  these,  as  well  as  for  facilitory  causes. 

Given  evidence  of  reliable  covariation,  the  analyst  can  then 
investigate  three  further  dimensions  to  determine  whether  the  relationship 
seams  dispositional  and  intentional,  rather  than  environmental  and 
situational.  These  dimensions  (suggested  by  Kelley,  196?,  baaed  on  J,  §, 
Hill’s  method  of  difference)  are  consensus,  consistency,  and 
distinctiveness* 

Consensus  refers  to  the  degree  to  which  other  refers  demonstrate 
the  same  causal  relationship*  Suppose  the  suspected  causal  relationship 
is  "Soviet  interest  in  Third  World  influence"  (cause)  led  to  "forward 
deployment  of  the  Soviet  &aoy*  (effect),  if  other  nations  also  undertake 
vide  scale  naval  deployments,  the  action  Cor  effect)  is  not  unique,  i.e., 
it  has  High  consensus,  Qn  the  other  hand,  If  only  the  Soviet  Wavy 
undertakes  far-flung  deployments,  their  behavior  is  unique  and  Has  Im 
consensus  - 

Consistency  refers  to  contest,  time,  anil  modality  of  response, 
has  the  Soviet  H&oy  consistently  deployed  forward  over  time,  or  did 
forward  deployment  develop  suddenly!?  Sees  tt>w  Soviet  Savy  consistently 
maintain  a  forward  deployed  force,  or  uoes  the  force  expand  or  contract 
with  dit f event  situations?  Are  Soviet  forward  deployments  consistently 
composed  of  the  same  units  or  types  of  ships,  or  does  the  modality  of 
response  vary? 
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Distinctiveness  refers  to  the  target  of  the  response.  Is  the 
Soviet  forward  deployment  limited  to  particular  target  areas  within  the 
Third  World  or  to  the  entire  Third  World?  Are  Soviet  responses  in  certain 
regions  different  than  in  others?  Highly  distinctive  responses  are  ones 
that  occur  only  for  a  small  set  of  possible  targets.  Low  distinctive 
responses  are  ones  that  occur  across  all  targets. 

Soviet  forward  deployment  can  most  confidently  be  attributed  to 
Soviet  dispositions  and  intentions  if  it. is  low  in  consensus  (other 
nations  do  not  undertake  far-flung  naval  operations),  if  it  is  highly 
consistent  (the  Soviets  consistently  maintain  a  high  level  of  forward 
deployment  over  time  and  deploy  forces  of  consistent  composition),  and  if 
it  has  low  distinctiveness  (the  Soviet  Navy  deploys  throughout  the  Third 
World).  To  the  degree  that  the  Soviet  response  is  high  in  consensus  or 
distinctiveness,  or  low  in  consistency,  the  analyst  should  begin  to  look 
beyond  the  Soviets*  dispositions  and  intentions,  and  consider 
environmental  or  situational  forces.  In  particular,  specific  information 
on  the  distinctive  features  that  lead  to  Soviet  responses  and  the  causes 
of  inconsistencies  (i.e.,  changes)  in  the  timing  or  modality  of  Soviet 
responses  provides  the  analyst  with  predictive  power. 

It  is  instructive  to  apply  Kelly*e  covariation  method  to 
McConnell's  classification  of  Soviet  Third  World  diplomacy  of  force 
(Table  4.3.),  The  first  three  case  categories  are  actions  that  most 
naval  states,  not  just  the  USSK,  would  undertake  in  the  Third  World,  The 
first  two  of  these  casts  would  only  he  undertaken  by  the  Soviets  in 
certain  contexts  and  with  distinctive  targets,  e.g.,  the  Soviets  do  not 
always  support  the  domestic  government  of  a  Third  World  country,  it 
depends  on  the  context  and  the  country.  The  lost  four  cases  all  evidence 
the  same  pattern,  low  consensus  (other  naval  nations  would  not  tend  to  do 
these  things)  which  suggest  Soviet  disposition  and  intention,  low 
consistency  which  implies  the  Soviets  take  these  actions  infrequently  or 
only  in  limited  contexts,  and  high  distinctiveness  which  means  these 
actions  are  taken  only  on  behalf  of  certain  distinctive  countries* 

The  only  case  for  which  Soviet  action  has  high  consistency  and  low 
distinctiveness  is  ease  category  3?  defense  of  citizens  ond  property* 
The  Soviets  ate  likely  to  perform  this  action  in  most  contexts  and 
regardless  of  the  character  of  the  offending  nation.  However,  the 
consensus  is  also  high,  most  other  naval  nations  would  also  undertake  to 
defend  citizens  and  property, 

in  none  of  these  cases  do  we  observe  the  “perfect  disposition 
pattern  M  i.e*,  a  pattern  that  would  suggest  the  Soviets  are  acting  only 
on  the  basis  of  their  own  intentions  and  dispositions*  Nor  do  we  observe 
a  purely  situational  pattern,  i.e.,  evidence  that  the  Soviet®  only  react 
to  specific  contests  and  targets  and  do  so  as  all  other  naval  nations  do* 
Instead  we  see  a  pattern  that  it  situational  relative  to  contest  and 
targets,  but  relatively  unique  to  the  Soviets,  especially  with  respect  to 
Third  World  international  security.  like  KtEiMMli'i  point 
to  the  critical  features  of  contact  and  targets  Thai  predispose  Soviet 
actions,  and  thy®  perform  a  highly  heuristic  function  for  both 
cause-effect  analysis  and  predict ion*  The  application  of  HelSey*® 
covariation  categories  nay  serve  tu  the  relative  weight  and 
importance  of  these  critical  feature®  in  the  analyst *s  aodei*  especially 
as  individual  cates  in  a  category  art  assessed. 
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Toblo  4.3.  Analysis  of  McConnell's  Clasoificntion  of  Cases  In  Soviet 

Third-World  Diplomacy  of  Vorce  in  Teresa  of  Consenuus,  Consistency! 
and  Distinctiveness. 


Consensus  Consistency  Distinctive! 
-High  how  High  Uw  High 

1.  Security  on  the  High  Seas 

1.  Demonstration  of  intent 
to  protect  USSR  assets,  or 
the  assets  of  clients,  at 

sea.  X  XX 

II.  Third  World  Domestic  Security 

2.  Demonstration  of  support  for 
the  domestic  authority  of  oa 

established  government.  X  XX 

3.  Demonstration  against  on 

established  government  in 
defense  of  Soviet  citiscos 
and  property.'  X  X  X 

4,  Military  support  to  * 
domestic  faction  during  an 
interregnuua  when  the  U-S.  is 
inhibited  fro©  eouoteriavolve- 

pent .  XXX 

XII.  Third  World  International  Security 

5,  Demonstration  of  intent  to  pro¬ 
tect  a  client  in  a  confrontation 

*  with  a  state  that,  hold  in  odiusi 
by  the  international  community, 

does  not  enjoy  U-$,  patronage.  X  XX 

6,  Demonstration  of  support  for  a 

client  threatened  <ee  that  might 
be  threatened)  fey  a  Western 
great  power  or  in  actual  con¬ 
flict  with  such  a  power,  X  XX 

y,  Demonstration  or  actual  inter¬ 
vention  against  a  D,§,  el lent 
that  is  defeating  a  Soviet 

client.  X  XX 

X,  Perfect  Disfwsitioafti  fatter©  X  X 

3.  reflect  Situational  Pattaca  X 


Case  Divio Ions  and 
Categories 


U9 
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Causal  warnings.  In  closing  this  section  on  assessing  causes  and 
effects,  it  is  worth  noting  that  Booth  (SNI ,  ch.  24)  offers  his  fellow 
naval  analysts  several  pieces  of  advice  on  cause-effect  assessment  "to 
prevent  an  influence  relationship  being  seen  in  too  simple  a  fashion  (p, 
470)."  His  warnings  closely  parallel  some  of  the  observations  made  above. 
Booth's  points  are  listed  on  the  left  in  Table  4.4  with  psychological 
mechanisms  on  the  right.  The  fact  that  Booth  takes  pains  to  summarize 
these  various  problems  in  causal  analysis  in  detail,  and  offers  clear 
warnings  to  other  analysts,  suggests  that  causal  biases  are  not  minor 
problems  in  naval  analysis.  Booth  himself  notes  "the  frequent  difficulty 
of  identifying  the  precise  relationship  between  naval  causes  and  political 
effects."  To  some  degree  these  difficulties  originate  in  the  problems  all 
people  have  in  assessing  causes  and  effects. 

Prediction 

Predicting  and  forecasting  are  central  tasks  in  intelligence 
analysis*  However,  naval  and  roilitary  intelligence  analysts  often  have 
been  charged  with  being  unable  to  accurately  predict  either  the 
capabilities  or  intentions  of  adversaries.  For  example,  Albert 
Wohlstetter  (1974a,  b,  c;  1975a,  b)  demonstrated  how  U.S.  intelligence 
analysts  persistently  underestimated  several  measures  of  Soviet  strategic 
forces  in  the  mid-1960s  and  early  1970s.  Several  scholars  have  noted  the 
consistent  tendency  in  the  late  1950s  and  early  1960s  for  U.S. 
intelligence  analysts  to  overestimate  these  same  measures  (e.g.»  Dick, 
1972;  Gray,  1972,  Licklider,  1970).  Lee  (1977)  described  how  the  U.S.  CIA 
underestimated  Soviet  defense  expenditures  by  a  factor  of  two  and 
ultimately  publicly  revised  its  estimates  upward.  Whether  the  CIA  is 
presently  over-  or  underestimating  Soviet  defense  expenditures  remains  an 
open  and  heatedly  debated  issue  which  puts  into  question  current  CIA 
forecasts  of  Soviet  defense  efforts  (cf .  Cockle,  1978;  Holzman,  1980). 
That  is,  a  methodology  that  misestimates  past  spending  cannot  be  relied 
upon  to  estimate  future  spending. 

Not  only  are  intelligence  analysts  charged  with  failing  to  predict 
capabilities  accurately,  they  often  are  accused  of  inability  to  estimate 
future  intentions,  Nany  writers  have  commented  on  the  seemingly  frequent 
fail  ores  of  intelligence  to  forecast  surprise  attacks,  crises,  changes  in 
policies,  etc,  (some  recent  papers  are  Ben-svi,  197b;  Betts,  1978,  1980; 
Chan*  1979;  Sarit,  1180;  Mandel*  1980;  Shlaim,  1976;  for  a  review  of 
literature  and  an  analysts  of  intelligence  failures  to  predict  intentions, 
see  stech,  19  9),  Seme  writers  (e,g.,  Betts,  1978)  argue  that  failure  to 
predict  intentions  accurately  is  inevitable, 

<hffltr§l  jutd  specif ic.  causes „M_  failure*  Hany  of  the  critics  of 
Intel!  i  gen  ee  "f  ally  res  'emphasise 'the  "p&l  it  lea  i  nature  of  chi*  task*  Seme 
note  that  intelligence  analysts  are  subjected  to  pressures  by  their  own 
government  m  corns  up  with  the  "right"  predictions;  i*e.,  those  that  serve 
the  deeision“«afeers*  purposes,  other  critics  point  to  the  dilemmas 
intelligence  analysts  face  as  they  attempt  to  act  out  organisational  and 
political  roles  and  also  produce  objective  estimates.  Still  other  critics 
point  to  nonpoliiical  factors*  such  as  the  complexity  of  the  international 
political  environment;  the  significant  problem  «f  separating  warning 
signals  and  intention  indicators  fro*  random  background  noise  or  deception 
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Table  4.4.  Booth's  Causal  Warnings  to  Naval  Analysts  and  Related  Biases* 


Booth's  Warnings 


Related  Biases 


1.  We  must  not  be  hypnotized  by  ships 
at  sea,  but  instead  see  them  in 
relation  to  a  country's  overall 
influence-building  tactics. 

2.  We  must  not  mistake  what  a 
particular  government  claims  or  hopes 
to  be  its  influence  and  what  its  in¬ 
fluence  actually  is;  nor  must  we  confuse 
the  effort  to  achieve  influence  with  its 
actual  achievement.  ...(We)  are  likely  to 
know  far  more... about  the  policy  aims  and 
tactics. • .than  (about)  the  effects  of  those 
aims  and  tactics... 

3.  Whether  or  not  naval  tactics  increase 
one  country's  influence  with  another,  for 
organizational  reasons  navies  are  likely 
to  claim  influence  potential,  while 
decision  makers  will  be  predisposed  to 
make  some  political  use  of  naval  forces  in 
order  to  cry  to  maximize  what  is  an  in* 
crcasingly  costly  investment. 

4.  We  must  be  careful  to  distinguish  the 
possible  influence  of  A*s  acts  on  B  with 
behavior  by  B  that  might  be  the  result  of 
a  coincidence  of  interests.  The  perti¬ 
nent  question  is;  "Would  B  have  behaved 
in  that  way  in  any  case?"  This  is  a 
particularly  important  warning  because 
the  evidence  for  influence  is  often  only 
circumstantial* 

5.  We  must  keep  in  mind  that  influence  is 
at  least  a  two-way  process . .  .ve  are 
interested  in  more  than  the  influence  of 

A  on  0.  the  multidimensionallty  of  the 
influence  process  eeans  that  ve  must 
speculate  about  the  effect*  of  acts 
on  mt  only  S's  rulers,  but  on  all  signifi¬ 
cant  groups  in  B*a  political  life,  on  third 
parties  (C,  0,  S,  F,  and  so  co>,  and  on 
political  groups  within  A.  To  the  extent 
that  A*s  naval  acts  affect  the  expectations 
of  all  these  groups,  it  lias  influence-build* 
iog  potential,  in  a  ewiltifacetcd  way. 


1.  Salience  und  vividness. 


2.  Representativeness  bias. 
Deterrence  trap.  Misguided 
parsimony. 


3.  Implicit  linking  of  foreseeability 
and  intention.  Mixing  capabilities, 
intentions,  and  causality. 


4,  Biases  of  covariation  assessment 
and  hypothesis  testing.  Magical 
thinking.  Fundamental  attribution 
error*  Mistaking  c banco  for  causation* 


5,  Causal  search  biases,  minimal 
causation,  and  causal  hydraulics. 


*Fro«  Booth  (mii  410), 
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action;  organizational  problems;  or  personality  problems  among 
intelligence  chiefs. 

The  argument  that  the  problems  of  intelligence  prediction  are 
unique  to  the  characteristics  of  the  subject,  i.e.,  predicting 
capabilities  and  intentions,  would  gain  strength  if  other  forecasting  and 
predicting  tasks  were  performed  accurately.  That  is,  if,  e.g.,  economists 
could  accurately  predict  the  growth  of  the  U.S.  economy,  we  would  be  more 
willing  to  attribute  failures  in  the  estimation  of  Soviet  defenses  as 
being  due  to  some  unique  aspects  of  the  latter  problem.  Similarly,  if 
forecasters  could  accurately  estimate  the  energy  needs  of  the  future,  or 
the  demand  for  transportation,  we  would  be  more  willing  to  grant  that 
intelligence  estimates  of  future  intentions  pose  unique  problems  because 
of  their  political  or  national  security  nature. 

It  is  not  the  case,  however,  that  forecasts  and  predictions  of 
nonpolitical ,  nonnational  security  matters  are  accurate,  (see  e.g., 
Ascher,  1978).  If  anything,  intelligence  forecasts  and  predictions  are 
about  as  accurate  as  forecasts  in  such  fields  as  population,  economics, 
energy,  transportation,  and  technology;  i.e.,  not  very  accurate  at  all. 
This  suggests  that  the  problems  are  with  the  tasks  of  forecasting  and 
predicting  in  general ,  and  are  not  specific  problems  of  intelligence  work. 
This  judgment  is  consistent  with  the  overall  approach  here,  i.e.,  that 
people  are  not  particularly  good  at  processing  data,  integrating  it  into 
covariation  or  causal  models,  or  making  predictions.  This  does  not  mean 
that  there  are  not  unique  problems  in  intelligence  prediction  and 
forecasting.  There  may  be  features  in  intelligence  work  that  make 
prediction  harder  than  in  other  fields.  But  if  the  ability  to  predict  and 
forecast  in  general  is  weak  (and  it  is)  there  would  seem  to  be  little 
payoff  in  addressing  u  ique  features  and  ignoring  the  general  features 
that  keep  people  from  making  accurata  predictions.  And  since  intelligence 
analysts*  failures  are  attributed  by  critics  to  a  variety  of  biases, 
weaknesses,  vulnerabilities  and  temptations,  it  is  only  fair  to  compare 
these  failures  to  those  that  seem  to  characterize  virtually  ail  forms  of 
systematic  prediction  and  forecasting.  In  short,  nobody  forecasts  or 
predicts  anything  very  well,  intelligence  analysts  are  apparently  no 
except  ion,  and  the  problems  of  forecasting  and  prediction  are  probably 
general  as  well  as  specific  to  a  field* 

Illusions  of  control,  People  have  a  strong  need  to  master  and 
cent roi One  expression  of  this  need  is  the  attempt  to 
predict  future  events.  In  dealing  with  chance  events  people  often  are 
willing  to  predict  outcomes  with  great  confidence  if  they  have  a 
perception  '•*#  control,  e.g,,  an  experience  af  early  successes,  or  control 
over  the  dice,  or  fits  opportunity  to  chouse  alternatives  (banger, 

Given  such  opportunities  people  attribute  successes  and  accurate 
predictions  to  their  own  efforts,  Hogarth  and  Makridakis  (I9?V>  note  the 
'uncanny  similarity  between  »  ,  *  forecasting  and  experiments  concerning 
the  illusion  of  control,”  Forecasters  are  likely  to  perceive  the  future 
as  note  predictable  than  it  is  sisply  because  of  their  efforts  to  predict 
it* 


Ulus ion  of  order,  delated  to  the  effects  of  the  illusion  of 
control  That  way  result"  ires  the  effort  of  predicting  is  the  tendency  to 
toe  patterns  where  none  exist,  an  'illusion  of  order,'*  The  need  to 
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structure  the  environment,  to  make  sense  out  of  it,  forces  people  to 
organize  perceptions,  in  keeping  with  "Gestalt"  principles  of  symmetry, 
closure,  proximity,  good  continuation,  and  common  fate  (Hogarth,  1975). 
People  abhor  randomness  and  persist  in  imposing  patterns.  Hogarth  (1975: 
273)  quotes  Simon  and  Sumner  (1968)  on  this  tendency: 

People  appear  to  have  strong  propensities  ...  to  discover 
patterns  in  temporal  sequences  presented  by  the  environment 
and  to  use  these  evidences  of  pattern  for  prediction  .  .  . 

The  urge  to  find  patterns  extends  even  to  phenomena  where 
one  may  well  doubt  whether  pattern  exists. 

The  need  to  find  patterns  is  so  strong  that  it  extends  ironically  to  those 
who  generate  random  patterns  when  parts  of  a  series  of  random  numbers  may 
not,  themselves,  appear  sufficiently  random  (Lopes,  1980): 

Fisher  and  Yates  found  that  some  of  the  random  numbers  they 
produced  failed  certain  tests  of  randomness.  What  did  they 
do?  The  obvious  —  they  fiddled  with  the  numbers  until  they 
were  random  enough  to  pass  the  tests.  Kendall  and  Babington 
Smith  had  a  similar  problem  involving  10,000  of  the  numbers 
they  generated,  which  they  solved  by  the  simple  expedient  of 
suppressing  the  offending  numbers. 

One  reason  people  are  relatively  insensitive  to  randomness  and 
uncertainty  is  that  they  rarely  consider  the  hypothesis  that  the  pattern 
or  process  they  perceive  is  probabilistic  rather  than  deterministic 
(Brehmer,  1980).  In  studies  of  probabilistic  inference  tasks  people  seem 
to  make  these  assumptions  in  the  following  order:  (1)  there  is  a  rule, 
(2)  it  is  deterministic,  (3)  it  depends  on  the  case  (rather  than  on,  say, 
the  sequence),  (4)  the  rule  is  functional  (rather  than,  nay,  conceptual), 
(5)  the  function  is  positive  linear,  Brehmer  wrote  (p.  231) 

When  these  rules  .  *  .  fail,  the  subjects  tend  to  assume 
that  there  is  no  rule  at  all,  rather  than  to  seriously 
consider  the  possibility  that  the  rule  may  be  probabilistic 
in  character. 

This  insensitivity  to  the  probabilistic  character  of  the  events  they  are 
attempt ing  to  predict  seems  to  underlie  many  of  the  problems  of 
forecasters  and  estimators. 


Problems  with  long-range  forecasts. 

Assumption  is  the  mother  of  all  screw' ops. 

Ue'chetn's  Law 

tong-range  forecasts  (two  years  or  ante  into  the  future)  are 
rarely  Meataw*  in  offensive  and  weii“doeu«teneed  appraisal,  Aschet 
( I9J8)  compared  predict  ons  to  outcomes  in  five  feresastiftg  areas: 
population,  economies,  energy,  transportation,  and  technology.  In 
general,  prediction  errors  are  large,  ranging  froa  a  fee  percentage  points 
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to  several  hundred.  He  detected  systematic  biases  as  well  as 
unpredictable  biases.  Commonly,  all  forecasts  in  a  given  period  show  the 
same  bias.  There  was  no  way  of  knowing  beforehand  which  approach  or 
forecaste c  would  be  most  accurate.  Differences  between  the  accuracy  of 
different  methods  (e.g.,  simple  or  sophisticated)  was  minimal.  Ascher  did 
find  some  evidence  of  a  learning  effect,  the  predictions  tended  to  be  less 
inaccurate  in  fields  with  the  longest  history  of  forecasting  experience. 
In  general,  however,  the  more  distant  the  forecast  target  date  the  less 
accurate  the  forecast  accuracy.  The  one  central  difficulty  among 
forecasts  was  in  providing  good  core  assumptions  regarding  the  phenomenon 
being  predicted: 

The  core  assumptions  .  .  .  the  forecaster's  basic  outlook  on 
the  context  within  which  the  specific  forecasted  trend 
develops,  are  the  major  determinants  of  forecast  accuracy 
.  .  When  the  core  assumptions  are  valid,  the  choice  of 
methodology  is  either  secondary  or  obvious.  When  the  core 
assumptions  fail  to  capture  the  reality  of  the  future 
context,  other  factors  such  as  methodology  generally  make 
little  difference  (Ascher,  1978:  199). 

Ascher 's  conclusions  about  the  critical  role  of  key  assumptions 
about  the  future  context  bear  a  striking  resemblance  to  the  conclusions  of 
cognitive  psychologists  assessing  the  central  elements  of  problem-solving 
expertise.  For  example,  Larkin,  McDermott,  Simon,  and  Simon  (1980:  1342) 
write  that : 

In  every  domain  .  .  .  knowledge  has  been  found  to  be.  an 
essential  prerequisite  to  expert  skill  .  ,  .  large  numbers 
of  patterns  serve  as  an  index  to  guide  the  expert  ...  to 
relevant  parts  of  the  knowledge  .  .  .  This  knowledge 
includes  sets  of  rich  schemata  that  can  guide  a  problem's 
interpretation  and  solution  and  add  crucial  pieces  of 
information.  This  capacity  to  use  pattern-indexed  schemata 
la  probably  a  large  part  of  what  we  call  .  .  .  intuition. 

In  other  words,  the  patterns  the  expert  problem-solver  perceives  guides 
the  problem  solution,  just  as  the  forecaster's  core  assumptions  about  the 
future  context  guide  the  forecast.  If  the  wrong  patterns  for  the  problem 
are  perceived,  or  the  wrong  assumptions  about  the  future  context  are  made, 
experts  tend  to  make  errors,  despite  their  knowledge  or  methods. 

Hgdiua^gem  forecasting.  In  many  forecasting  fields  the  analysis 
of  pat  terns  "TT  “past "  trends''^  best  accomplished  by  statistical  analysis. 
To  the  degree  that  mediu«~tnr»  (throe  mouths  to  two  years)  future 
forecasts  are  based  on  trend  projections,  a  simple  quantitative  model 
should  provide  fairly  accurate  estimates.  In  fact,  for  a  variety  of 
quantitative  predictions  (stock  market  and  esisnessic  forecasting,  autuai 
fund  per fosgaoce ,  future  sales  and  earnings  estimates,  currency  exchange 
ratios,  oil  prices,  suture  pt&iuet  demand)  Hogarth  and  Hakridakis 
found.  So  a  review  of  the  literature,  that  simple  quantitative  tw4sis  were 
more  accurate  thaa  the  Judgments  of  forecasters* 
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Short-term  forecasts 


An  ounce  of  history  is  worth  a  pound  of  logic. 

Oliver  W.  Holmes 

Similarly,  the  present  states  of  many  variables  are  predictive  of 
the  short-term  (less  than  three  months)  future.  Again,  Hogarth  and 
Makridakis  found  that 

.  .  .  rather  simple,  mechanistic  methods  such  as  those  used 
in  time  series  forecasting  can  therefore  often  make  accurate 
short-term  forecasts  and  even  out-perform  more  theoretically 
elegant  and  elaborate  approaches  used  in  econometric 
forecasting  •  .  .  quantitative  models  outperform  judgmental 
forecasts  .  .  .  simpler  models  are  often  at  least  as 
accurate  as  sophisticated  ones  .  .  .  simple  decision  rules 
can  often  be  as  effective  as  elaborate  forecasting  at  4 
planning  procedures. 

To  what  extent  are  naval  analysts  guilty  of  making  sophisticated 
or  complex  judgments  about  the  short-  or  medium-term  future  when  simple 
quantitative  projections  would  probably  serve  as  well  or  better!  Since 
this  study  undertook  no  explicit  comparisons  of  predictions  and  outcomes, 
we  cannot  relate  quantitative  evidence  of  inappropriate  sophistication, 
however,  it  was  repeatedly  encountered.  Rather  than  simply  extrapolate 
trends,  naval  analysts  tend  Co  develop  elaborate  models  of  process  to 
predict  future  events. 

A  not  atypical  example  is  shown  in  Figure  4.5,  which  was  displayed 
in  an  article  on  a  methodology  for  threat  projections  (Ivanoff  and  Murphy, 
NFSP:  149).  On  the  left  is  an  index  for  antiship  missile  momentum  which 
is  simply  a  measure  of  the  payload  weight  (w^)  times  the  missiles  maximum 
speed  (V  ),  The  solid  points  represent  successive  generations  of  Soviet 
missiles.  The  open  circles  are  the  estimates  for  future  Soviet  missiles 
given  by  the  authors*  methodology.  The  triangular  point  is  the  U.S. 
Harpoon  antiship  missile*  The  analysts  forecast  a  sharp  exponential 
acceleration  in  the  value  of  momentum  —  a  jump  unjustified  by  the 
historical  data.  They  explain  this  jump  in  capability  as  resulting  from 
(l)  the  absence  of  past  improvements  and  (2)  the  availability  to  the 
Soviets  of  the  neaesoery  propulsion,  guidance,  and  materials  technologies 
that  would  allow  such  a  jump. 

Assumption  <i)  is  similar  to  the  gamblers*  fallacy,  i,e*»  the 
belief  that,  e.g»,  the  roulette  wheal  which  has  not  some  up  even  for  ten 
consecutive  spins  is  '‘dee’*  for  an  even  number.  The  analysts  seem  to  take 
the  fact  that  the  Soviets  Ixave  not  made  technical  improvements  in  a  system 
in  many  years,  even  improvements  of  which  they  are  fully  capable,  as 
implying  they  are  “due”  for  a  change.  The  Soviets  say  have  compelling 
uontechuelogicai  reasons  to  leave  an  adequate  design  atone  e.g», 
perhaps  it  leads  to  missiles  that  are  very  easy  to  service,  cheap, 
reliable,  compatible  with  other  systems,  etc.  The  ability  to  do  it  better 
does  not  imply  a  need  or  desire  to  do  it  better.  ~ 

The  Soviets  did  not  wake  simultaneous  exponents al  breakthroughs  in 
technologies  in  the  aid- !9?0s.  the  technologies  needed  to  sake  the 
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Figure  4,5.  An  Example  of  Oversophisticated  Forecasting* 


estimated  jump  in  motsmcum  have  been  evolving  throughout  the  historical 
period  of  Soviet  antiship  missile  development.  Successive  generations  •*£ 
Soviet  missiles  have  not  reflected  (in  their  momentum)  any  sweh  evolution, 
yet  the  analysts  estimate  that  suddenly  they  will.  The  fact  that  the 
Soviets  have  consistently  produced  missiles  that  are  less  than 
state-of-the-art  is  ignored  and  the  heretofore  unnoted  practice  of 
building  state-of-the-art  weapons  is  accepted  as  the  trend  for  the  future. 
This  is  worst-cast  estimating;  the  Soviets  are  estimated  to  be  planning 
to  build  the  worst  they  possibly  can,  although  they  seem  not  to  have  done 
this  in  the  past  (i.e«,  they  often  follow  the  masim  that  the  “better  is 
enemy  of  the  good . “ ) 

Clinical  versus  actuarial  judgment.  Forecasters  and  naval 
analysts  are  not  the  only  judges  whose  estimates  are  more  sophisticated 
than  but  often  inferior  to  simple  quantitative  models  of  the  data. 
Psychologists  have  found  that  human  judges  in  general  are  inferior  to  such 
mathematical  or  actuarial  formulas  derived  tram  the  diagnostic  input  data 
(see  Dawes  and  Corrigan,  1974;  Coldherg ,  196S,  1970,  Heeht ,  1959,  Slavic 
and  Lichtenstein,  1971  for  reviews  of  this  literature).  Even  mathematical 
models  of  the  human  judges  themselves  (rather  than  s£  tba  input  data) 
outperform  the  judges  because  the  models  are  more  reliable  and  censisgent 
than  the  humans, 

human  judges  are  less  accurate  predictors  than  the  mathematical 
models  whether  the  humans  have  more  information  than  is  fed  into  the 
formulas,  or  the  same  data.  Sven  if  the  judges  are  informed  of  the 
weights  given  data  in  the  actuarial  formula,  @r  the  specific  predictions 
of  she  formula,  the  judges  do  worse, 

hot  only  ate  human  judges  less  accurate  than  the  optimal 
mathematical  regression  models  of  the  data;  they  are  less  accurate  than 
almost  any  regression  equatiea,  Sven  if  the  model  weights  input  data 
arbitrarily,  as  long  at  she  weights  ftenasra,  positive,  and  linear,  the 
mndeli  uufpredict  human  judges  tfnm%  mi  Corrigan,  1974).  Mumaa  judps 
apply  invalid  weights  te  data  and  weight  data  unreliably.  The  models 
auspredict  humans  because  of  improved  tell ability  alone , 

In  many  respeats  shit  reseat  eh  wish  human  judges  actually  gives 
the  humans  their  best  advantage.  The  judges  ate  tfpLmtlf  shilled 
professionals,  making  predict  ions  In  fields  far  which  they  have  sp-iclal 
knowledge  and  much  e^pefienae.  The  judges  generally  receive  feedback  an 
their  predictive  accuracy-.  They  have  ample  time  w  study  the  data  and 
per  form  calculations.  The  data  ate  often  presented  in  vnil“osga©isied  and 
eategoris«d  fern, 

■  dlgtigns_  jnd _re|!igs§nf filyeness .  §ne  rease-s  why  analysts  may 
t  over  if  e at 4i 1  I§n#  that  are  inleriM  to  timplt 
*  .  gelations  #f  quant itatfvfe  projeetiens  is  the  repre#e-Mativeness 
heurlntif,  that  is,  people  tend  ignore  basesrate  data,  i.|<(  |rtw 
probabilities*  pop-ulatinn  prapertiens,  data  an  averages  or  central 
tendencies,  #a  the  §fh§?  Hand,  people  ever  emphasise  das#  on  the  specific 
target  case,  the  particular  event,  object,  or  about  which  the 
prediction  is  to  he  made,  h&sbett  and  fins*  142)  write: 

ftaple  are  thus  insof  fie  lent  ly  concerned  with  the  relative 

frequencies  of  the  varions  outcome  possibilities  mi,  are 
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overly  concerned  with  the  degree  to  which  features  of  the 

target  are  similar  to  features  of  some  particular  outcome. 

In  the  case  of  the  capabilities  predictions  made  by  Ivanoff  and 
Murphy  ( NPSP ,  see  above),  the  anlysts  have  overemphasized  the 
state-of-the-art  case  and  underestimated  the  base-rate  of  the  Soviets' 
past  track  record.  Unless  the  analysts  are  entirely  confident  that  future 
Soviet  missiles  will  resemble  the  state-of-the-art  case,  they  should 
regress  their  predictions  toward  the  average  of  past  Soviet  performances. 
To  the  degree  that  the  case  data  are  believed  to  be  less  than  perfect 
predictors  the  estimated  missile  characteristics  should  be  regressed 
toward  the  average  of  past  performance. 

Regression  effects.  Closely  related  to  the  neglect  of  base-rate 
data  is  the  tendency  to  assume  that  predictor  variables  are  perfectly 
related  to  predicted  variables.  That  is,  an  extreme  score  on  a  predictor 
variable  is  often  taken  as  predicting  an  equally  extreme  score  on  the 
predicted  variable.  This  is  true,  however,  only  if  the  two  variables  are 
perfectly  correlated,  i.e.,  the  predictor  is  perfect.  When  the  predictor 
variable  is  not  a  perfect  index  of  the  predicted  variable,  the  estimator 
should  regress  the  prediction  from  the  predicted  value  toward  the  mean 
value  of  the  entire  data  set.  To  the  degree  that  the  correlation  between 
predictor  and  predicted  variables  decreases  (i.e.,  the  predictor  becomes 
less  diagnostic)  the  prediction  should  be  shifted  closer  to  the  mean. 

A  hypothetical  example  of  nonregressive  prediction  might  be  a 
naval  analyst  who  estimates  that  the  high  levels  of  Soviet  out-of-area 
operations  in  the  1973-1974  period  indicates  future  high  levels.  Having 
shown  that  they  were  capable  of  such  extensive  forward  deployment,  and 
having  gained  diplomatic  advantages  from  them  the  Soviets  might  be 
perceived  as  likely  to  continue  this  level  of  operations.  In  this  case 
the  analyst  is  using  an  extreme  case  (the  high  levels  of  deployment, 
.prompted  in  part  by  a  Middle  East  crisis)  as  a  predictor.  Since  this  was 
an  extreme  case,  unless  it  is  a  perfect  predictor  (unlikely  since  the  same 
factors,  e.g.,  crisis,  would  not  persist),  a  more  regressive  prediction 
would  be  in  order. 

Regressive  predictions  through  dilution.  Psychologists  have  found 
that  people  sometimes  make  regressive  predictions,  but  for  the  wrong 
reasons.  That  is,  when  people  were  given  data  on  predictor  variables  and 
information  that  was  totally  nondiagnostic  (i.e.,  known  to  be  unrelated  to 
the  prediction  task)  the  predictions  were  less  extreme  (i.e.,  regressed 
toward  the  mean).  In  other  words,  information  that  was  worthless  for 
prediction  served  to  dilute  the  effects  of  extreme  information  that  was 
highly  diagnostic  (hisbett  and  Ross,  1980:  154-155).  The  regression  of 
the  prediction  toward  the  mean  and  away  from  the  extreme  value  of  the 
predictor  variable  was  normatively  appropriate,  but  occurred  for 
inappropriate  reasons.  Rather  than  integrating  the  highly  diagnostic, 
extreme  information  with  nondiagnostic  data,  the  estimator  should 
integrate  the  extreme  value  with  base-rate  data,  regressing  the  extreme 
value  toward  the  mean  value  of  the  predictor  variables.  While  the 
dilution  bias  may  favorably  offset  nonregressive  case-specific 
predictions,  it  could  also  occur  at  inappropriate  times,  e.g., 
overdiluting  highly  predictive  indicators.  A  more  appropriate  means  of 
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adjusting  predictions  is  described  below  under  “sensitivity  testing." 

Diagnostic  and  nondiagnostic  data.  Psychologists  have  found  that 
people  will  make  heavy  use  of  case-specific  information  even  when  those 
data  are  held  to  have  low  predictive  validity  and  to  be  unhelpful  in 
prediction,  at  the  same  time  that  base-rate  data  are  ignored.  People  will 
thus  rely  on  specific  information  about  the  target  that  they  recognize  as 
relatively  invalid  and  nondiagnostic  while  ignoring  data  averages  which 
are  highly  diagnostic  and  should  be  rejected  only  if  very  strong 
diagnostic  data  on  the  target  case  are  available  (Kahn  man  and  Xversky, 
1973). 

Even  when  data  on  the  target  case  are  perceived  by  the  judge  to  be 
absolutely  worthless,  judges  persist  in  neglecting  available  data  on  base 
rates.  Instead  the  judges  proceed  as  if  no  data  were  available.  Only 
when  there  is  no  information  at  all  on  the  target  case  did  judges  make  use 
of  the  base-rate  data  (Kahneraan  and  Tversky,  1973;  Lyon  and  Slovic, 
1976). 


When  base-rate  data  are  used.  Several  psychologists  have 
challenged  Kahneraan  and  Tversky 's  (1973)  conclusion  that  base-rate  data 
are  totally  ignored  when  case-specific  data  are  available,  and  a  series  of 
studies  have  shown  that  people  do  attend  base-rate  information  in  certain 
circumstances.  In  particular,  base-rate  data  are  used  when  they  have  a 
clear  causal  relationship  to  the  base  being  predicted  (Ajzen,  1977; 
Bar-Hillel,  1977;  Tversky  and  Kahneman,  1977),  when  case  data  are  absent 
(Kahneraan  and  Tversky,  1973),  when  the  process  generating  the  base  data 
are  clearly  understood  (Howell  and  Burnett,  1978),  when  the  base-rate  data 
are  highly  concrete  (Manis,  et  al.,  1980).  Even  in  those  cases  In  which 
base-rate  data  is  employed  in  prediction,  people  failed  to  weight  it  as 
heavily  as  would  be  normatively  appropriate,  and  would  often  use  the 
base-rate  data  without  being  aware  of  doing  so  (Manis,  et  al.,  1980). 

As  Nisbett  and  Ross  (1980)  point  out,  people  are  quite  willing  to 
make  broad  generalizations  and  predictions  on  the  basis  of  a  single,  vivid 
case  study,  but  will  refuse  to  make  predictions  on  the  basis  of  data 
averages  that  may  reflect  large  numbers  of  cases.  Such  an  outlook  on  data 
synthesis  and  prediction  is  scientifically  unjustified.  The  belief  that  a 
single  case,  sampled  from  a  larger  population,  is  representative  of  the 
entire  population  is  an  extreme  instance  of  what  Tversky  and  Kahneman 
(1971)  labeled  “the  law  of  small  numbers";  a  belief  that  accurate 
inferences  and  predictions  about  the  population  can  be  based  on  very  small 
samples  of  data,  Their  research  demonstrates  that  even  scientists  have  a 
very  inadequate  understanding  of  the  relations  between  sampling  and 
statistical  inference  and  prediction. 

Sensitivity  testing' induced  hase-rate  use.  People  can  be  induced 
to  use  base-rate  information  even  when  it  is  not  causal,  concrete, 
produced  by  a  clearly  understood  process,  and  when  case  data  are  also 
present.  This  increased  use  results  when  people  are  asked  to  conduct 
subjective  sensitivity  tests,  i.e.,  to  determine  how  their  predictions 
would  be  changed  if  the  base-rates  had  very  different  values.  When  people 
considered  several  base  rates  they  tended  to  make  more  use  of  base-rate 
data  and  their  predictions  shifted  in  the  normatively  appropriate 
direction  (Fishhoff,  Slovic,  and  Lichtenstein*  1979).  Similarly,  when 
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people  considered  various  levels  of  validity  between  the  predictor 
variables  and  the  outcome,  they  weighted  data  more  appropriately,  i.e., 
giving  less  weight  to  less  valid  predictors.  None  of  the  naval  analysts 
reviewed  described  any  use  of  sensitivity  testing. 


Predictions,  scenarios,  and  compound  probabilities.  A  scenario 
consists  of  a  series  of  events  linked  together  in  narrative  form. 
According  to  the  mathematics  of  probability,  the  likelihood  of  a 
multievent  scenario  happening  is  the  multiplicative  product  of  the 
probabilities  of  the  indivi ’ual  links.  The  more  event  links  in  the 
scenario,  the  lower  the  probability  of  the  entire  scenario’s  occurrence . 
The  likelihood  of  the  scenario’s  least  likely  link  sets  the  upper  limit  on 
the  probability  of  the  entire  narrative.  Compound  events  cannot  be  more 
likely  than  the  least  probable  of  the  simpler  events  that  constitute  the 
compound . 

People  typically  do  not  evaluate  compound  events  or  scenarios  in 
this  way-  They  typically  judge  the  probability  of  a  multilink  scenario  on 
the  basis  of  the  average  likelihood  of  all  its  links  (Schum  and  Pfeiffer, 
1973;  Slovic,  Fischhoff,  and  Lichtenstein,  1976).  Strong  links  appear  to 
compensate  for  weak  links  and  scenarios  are  constructed  with  perceived 
probabilities  that  increase  as  they  become  longer,  more  detailed,  and  less 
normatively  probable.  Individual  weak  links  in  a  scenario  may  be 
perceived  as  having  low  probability,  but,  if  they  can  be  combined  to  tell 
a  good  story,  the  weak  links  are  buried  in  masses  of  coherent  details  and 
the  scenario  is  given  much  more  credibility  than  it  deserves. 

Ross  and  his  colleagues  (Ross,  Lepper,  Strack,  ami  Steinmetz, 
1977)  have  found  that  merely  identifying  potential  antecedents  to  explain 
an  event  increases  that  events*  subjective  likelihood.  Even  when  people 
knew  they  were  formulating  hyothetical  explanations,  they  believed  events 
were  more  likely  simply  because  they  had  produced  explanations  for  why  the 
events  would  or  could  occur.  In  other  words,  when  analysts  generate  a 
plausible  account  suggesting  how  a  particular  event  might  be  predicted 
from  past  data,  they  may  inappropriately  make  the  inferential  leap  from 
possibility  to  probability.  Merely  searching  for  possible  links  between 
antecedents  and  specific  consequences  may  produce  increased  subjective 
probabilities  for  the  predicted  events.  Similiarly,  merely  imagining  the 
occurrence  of  an  event  can  increase  the  person's  expectation  that  the 
event  will  occur  (Carroll,  1978). 

The  clearest  naval  example  in  our  sample  of  an  elaborate  scenario 
influencing  an  analyst's  estimates  of  likelihood  is  Ra ’anon's  account  of 
Soviet  decision-making  in  the  Middle  East  1969-1973  ( S N P ,  eh,  11), 
Ra'anan  takes  pains  to  fill  in  unknown  gaps  with  “a  logical  reconstruction 
of  the  course  of  events,  in  which  causes  and  effects  are  linked  coherently 
and  motivations  are  explained  lucidly"  (p.  183).  The  number  of  gaps  thus 
filled  is  quite  large,  and  the  individual  probabilities  of  many  of  his 
links  are  quite  low.  Ra'anan  judges  his  scenario  to  have  a  "speculative 
flavor (P,  210),  however,  it  is  more  likely  that  his  reconstruction  is 
quite  improbable  (ef,  Kerr,  1975), 


Theory-driven  overpredictions ♦  Theories  are  an  excellent  aid  for 
making  predictions.  By  specifying  “if  .  ,  .  then  ,  ,  ,*  relationships 
theories  predict  when  certain  events  can  he  expected  to  happen. 
Predictions  can  be  made  faster  and  more  confidently  when  the  analyst  has  a 
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theory  for  the  event  doma'n  than  if  he  or  she  does  not.  The  presence  of  a 
theory  may  lead,  however,  to  more  extreme  predictions  and  more  analyst 
confidence  in  predictions  than  is  warranted  by  the  data  (Fluke  and  Kinder, 
1978}  Taylor  and  Crocker,  1979).  Thinking  about  an  event  in  terms  of  a 
theory  seems  to  lead  to  overestimation  of  the  probability  of  the  event 
occurring  (Ross,  et  ai.,  1977).  Taylor  and  Crocker  (1979)  suggest  that 
imagining  events  in  terms  of  a  theory  evokes  temporal  sequences  between 
antecedents  and  consequences  and  clarifies  the  links  in  the  causal  chain 
connecting  them.  This  clarified  view  leads  to  a  higher  estimation  that 
the  theorized  chain  of  events  will  actually  transpire.  Hence,  both 
theories  and  scenarios  may  lead  to  excessive  analyst  confidence  in 
predictions. 

Illusion  of  validity.  Psychologists  have  repeatedly  demonstrated 
the  fal lability  of  subjective  prediction,  the  lack  of  predictive  and 
forecasting  accuracy  by  experts  in  a  variety  of  fields,  and  the  greater 
accuracy  of  simple  statistical  prediction  models  compared  to  expert 
predictions.  Despite  this  evidence,  experts  and  laymen  persist  in 
belioving  in  the  superior  accuracy  of  their  forecasts  and  predictions 
(Kinhorn  and  Hogarth,  1978).  Experts  and  laymen  are  overconfident  in 
their  predictive  judgments,  a  phenomenon  Kahneoan  and  Tvatsky  (1973) 
labeled  “the  illusion  of  validity’*} 

.  .  .  people  are  prone  to  experience  much  confidence  in 
highly  fallible  judgments  .  .  ,  Like  other  perceptual  and 
judgmental  errors,  the  illusion  of  validity  persists  even 
when  its  illusory  character  is  recognized. 

People  are  often  most  confident  of  their  predictions  (e,g.»  when  predictor 
cues  are  highly  redundant  or  extreme)  when,  in  fact,  the  data  they  use 
generate  the  least  accuracy  (Kahneoan  and  Tver sky ,  1973). 

The  reasons  why  people  persist  in  this  illusion  of  validity  and 
are  often  overconfident  in  fallible  predictions  are  discussed  in  greater 
detail  helou  under  “Forming,  maintaining,  and  chanting  theories*” 

Surprises  and  sudden  events,  Several  analysts  forecasting  and 
predict  High  a  v|  ™i*  e  aeheJ^  1 5ie  "'s  a  me  conclusions  about  the  difficulty  of 
accurately  predicting  distant  events,  namely  that  surprises,  or  unexpected 
sudden  events,  are  mtt  common  and  more  important  than  forecasters 
anticipate*  Forecasters  and  predictors  seem  to  tail  to  understand  the 
full  extent  of  uncertainty,  Hogarth  and  ^aktidakis  (19?9)  q.uoto  the 
economist  haul  Samuelson  on  this  issue. 

I  think  that  the  greatest  error  in  forecasting  is  not 
realising  Hew  important  are  the  probabilities  of  events 
other  than  those  everyone  is  agreeing  upon. 

Homage ,  a  meteorologist,  maf.es  a  similar  point  (1980;  268); 

Despite  great  increases  in  observation  density, 
communication  speed  and  computing  power,  (weather)  forecasts 
are  not  such  better  now  than  a  generation  ago*  The  reason 
seems  to  lie  in  unpredictable  turbulence  “hursts"  which 
contaminate  forecasts  beyond  two  or  three  days* 
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Ramage  notes  that  the  negative  impact  of  such  sudden  events  is  not 
confined  to  weather  but  afflicts  predictions  in  other  natural  and  social 
sciences  as  well. 

Ramage  argues  that  sudden  events  are  characterized  by 
unpredictability  and  environmentally  constrained  randomness ;  i.e  ,  they 
are  events  from  the  extreme  tails  of  frequency  distributions,  and  cannot 
bo  adequately  incorporated  by  studies  of  past  events. 

Ascher  (1978:  210)  reaches  a  similar  conclusion  about  forecasts 
and  their  core  assumptions.  Forecast  models  can  only  reflect  a  finite 
number  of  relationships,  a  limited  number  of  relationship-modifying 
factors,  and  must  include  some  invariant  relations.  This  limits  the 
structural  flexibility  of  the  model.  Ascher  notes,  however,  that: 

There  ie  reason  to  believe  that  the  turnover  in  "structures'* 
defined  at  any  level  is  increasing  in  this  rapidly  changing 
and  changeable  world.  .  .The  likelihood  of  unanticipated 
structural  changes  in  the  long  run  (i.e.,  ten  years  or  more) 
is  high,  so  the  usefulness  of  progress  in  forecast  methods 
relying  on  any  level  of  fixed  structure  is  minimized  for 
long-term  forecasts. 

To  cope  with  this  high  probability  of  unexpected  events,  Ascher 
calls  for  "specialized  surprise-sensitive  forecasting.”  By  this  he  means 
methods  that  would  be  "highly  sensitive  to  potential  surprise  outcomes, 
even  if  they  are  not  the  most  likely  outcomes."  The  future  problems  and 
crises  that  can  result  from  what  is  unlikely  to  happen  are  severe  enough 
to  warrant  "lookout  institutions,”  designed  to  anticipate  and  illuminate 
unlikely  problem  areas  before  they  develop  beyond  control. 

Such  institutions  are  not  unknown  in  military  and  naval 
Intelligence,  and  can  be  found  under  the  titles  of  "indicators,” 
"warning,”  “current  intelligence "watch  offices"  and  other  labels.  The 
main  problem  with  these  efforts  is  formulating  clear  patterns  to  watch  for 
that  will  indicate  events  that  have  never  happened,  or  happen  rarely. 
Since  tire  analysts  are  highly  unlikely  to  anticipate  the  "tight”  pattern 
exactly,  sosfc  (or  all)  warnings  will  have  to  be  teased  on  a  very  rough  fit 
fefctmn  the  indicator  patterns  (or  templates)  and  the  pattern  of  unfolding 
events.  A%  beet,  the  warning  office  way  be  able  to  issue  only  uncertain 
alerts,'1 

Ascher  offers  sever#!  recommendations  for  surprise-sensitive 
forecasting  which  eesspare  favorably  with  recent  roeoasseadations  m  how 
intelligence  analysts  should  deal  with  surprise  S&eit,  1980), 

¥!«*£,  deviations  gross  iong-tergs  patterns  should  fee  examined  m  possible 
new  ktetwi*  rathe?  than  as  merely  ephemeral  Sinee  most 

deviations  will  he  only  opheoarsl  and  not  new  trends,  the  surprise 
aft*  i  ye  its  will  register  waoy  false  alarm  and  will  stem  to  waste  a  great 
.deal  of  u**&  cMsiug  the  wiU'-o-thsr-visp.  This-  problem  say  be 
for  by  their  ability  m  register  new  trends,  although  not  oil  nnw  trends 
will  be  important.  Jfleing  sins  first  . to  note  tt»e«  nay  offset  their  many 
false  alamsu 

Second,  fcurpsise  fomasm#  should  be  allowed,  wrote  Ascher ,  to 
make  tetieutoa  free  of  plausibility  checks.  Their  projections  should  not 
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be  required  to  conform  to  anyone's  Intuitive  notions  of  whut  is  plausible. 
This  does  not  mean  that  the  forecasting  methods  should  not  be  plausible » 
only  that  forecasters  and  their  customers  should  consider  seriously  rather 
improbable  or  even  outlandish  projections*  If  such  projections  suggest 
outcomes  thet  would  be  extremely  dangerous,  it  will  be  worth  while  to 
monitor  their  possible  development. 

Third,  surprise-sensitive  forecasting  cannot  resort  to  consensus 
amalgams  of  the  forecasts  of  others.  Averaging  of  opinions,  or 
reiterative  judgments  aimed  at  arriving  at  consensus  will,  by  definition, 
eventually  exclude  the  improbable,  implausible,  and  unexpected  events  that 
surprise  forecasting  is  aimed  at  predicting.  The  use  of  Delphi 
techniques,  for  example,  is  ifine  if  the  aim  is  to  determine  the 
widdle-of-uhe  road  estimate,  but  it  cannot  possibly  be  relied  upon  to 
detect  surprises. 

Because  Delphi  techniques  are  commonly  used  in  forecasting,  it  is 
worth  exploring  this  last  point  with  an  example  from  naval  analysis. 
Thorpe  (NPSP,  ch*  8)  used  Delphi  questionnaires  to  determine  the  consensus 
of  experts  on  the  missions  of  various  Soviet  combatants.  Figure  A. 6 
reproduces  the  responses  for  one  such  question:  the  percent  of  the  Kresta 
It's  mission  that  is  ASM.  Note  that  the  median  response  distinctively 
shifts  to  the  right  and  that  the  overall  range  and  interquartile  range 
shrink  dramatically.  While  some  two  or  three  respondents  on  the  first 
questionnaire  thought  the  percentage  might  be  as  low  as  18  percent  or  as 
high  aa  100  percent,  by  the  third  round,  n£  experts  thought  the  percentage 
lower  than  30  percent  or  higher  than  85  percent.  The  extreme  cases  are 
explicitly  eliminated  by  the  Delphi  technique,  it  is  just  .'huso  extreme, 
improbable  cases  that  are  of  most  importance  in  surprise  forecasting. 

It  is  beyond  the  scope  of  this  study  to  completely  analyse  the 
problem  of  surprise  prediction.  For  both  forecasting  and  intelligence 
this  effort  is  highly  uncertain  and  speculative  Cef.  Aseher,  19?8;  Gazit , 
I980j  Handel,  1980).  The  problems  with  surprise  prediction  and  intention 
estimation  go  far  beyond  the  cognitive  and  methodological  limitations  of 
analysts.  (A  review  of  the  literature  on  the  estimation  of  intentions  and 
the  prediction  of  surprises  by  intelligence  analysts  is  found  in  Stech, 
19?9»  A  general  framework  for  analysing  surprise  is  outlined  there  which 
is  based  on  sociological  studies  of  disasters  and  of  scientific 
discoveries.}  An  important  element  of  surprise  and  surprise  detection  is 
the  theory  held  by  the  analyst* 

Forming.  Maintaining,  and  Changing  theories 

The  analyst's  theories  play  a  fundamental  role  in  the  preceding 
six  estimation  tasks*  Theories  imply  or  specify  which  data  are  important 
and  which  are  not,  and  lead  the  analyst  to  perceive  some  data  and  not 
others.  Theories  suggest  how.  data  should  be  weighted  and  conceptualised. 
Covariations  may  be  tK«ar)f*dflvw,  'i,«M  implied  by  a  theoretical 
relationship*  Theories  include  "if  ,  »  »  then  *  *  statements  which 
relate  causes  to  effects,  and  imply  causal  hypotheses.  Theories  and 
schemas  are  thus  strong  influences  §n  causal  reasoning*  Finally,  theories 
produce  predictions  and  influence  forecasts  by  shaping  the  core 
assumptions  used  by  the  estimator*  In  effect ,  the  process  of  estimation, 
which  we  have  divided  into  seven  stages,  actually  begins  vied  ends  with 
theory,  etui  each  stage  influences  the  estimator's  theories  and,  in  turn,, 
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is  influenced  by  these  theories.  An  estimate  is,  in  many  respects, 
nothing  more  than  a  very  specific  theory. 

In  this  section  we  examine  evidence  that  people  tend  to  persist  in 
holding  theories  and  beliefs  long  after  overwhelming  evidence  discrediting 
them  has  been  received.  This  general  tendency  to  conservatively  adhere  to 
theories  arises  from  several  problems  of  data  processing,  integration,  and 
inference.  Theories  and  beliefs  persist  to  such  a  degree©  that  even  after 
the  evidence  that  produced  them  is  totally  discredited,  the  beliefs  remain 
active.  People  seem  to  realize  that  they  need  schematic  mental  constructs 
like  theories  and  beliefs  to  organize  their  mental  world  and  to  cope  with 
their  environment,  but  they  seem  to  depend  on  a  given  theory  long  after 
they  should  have  rejected  it  for  another.  People  rarely  employ  more  than 
one  theoretical  vantage,  and  are  highly  inefficient  both  in  confirming  and 
in  disproving  theories. 

Theory  conservatism. 

An  easily-understood,  workable  falsehood  is  more  useful  than 
a  complex,  incomprehensible  truth. 

Thumb's  Second  Postulate 

A  theory  is  valid  and  accurate  if  it  makes  verifiable  predictions  that 
generally  turn  out  true.  Adhering  to  a  bad  theory  implies  chat  accuracy 
and  validity  are  sacrificed.  Theories,  however,  serve  other  purposes  than 
making  accurate  predictions,  First,  they  organize  knowledge  and 
streamline  investigations  by  providing  useful  categories,  relationships, 
and  weighting  criteria  that  systematize  data.  Even  though  the  system 
produced  by  the  theory  is  invalid,  i.e. ,  unable  to  accurately  predict,  it 
may  be  better  for  organizing  than  the  next  best  alternative,  or  no  system. 
Second,  accuracy  is  rarely  obtained  without  effort,  and  an  existing 
inaccurate  theory  may  be  mere  sensible,  from  a  cost -benefit  viewpoint, 
than  undertaking  the  expense  of  developing  a  new  theory  of  greater 
accuracy,  Hany  decisions  and  estimates  bated  on  invalid  theories  are 
nonetheless  reliably  accurate,  and  even  if  the  theory  leads  to  many 
errors,  these  may  carry  very  low  costs,  A  bad  theory,  in  other  words,  may 
yield  high  benefits  and  low  casts,  and  seem  quite  good  as  a  result, 
Revising  a  theory,  or  replacing  it,  is  likely  to  entail  considerable 
effort,  with  few  assurances  of  a  payoff  in  mere  beneficial  accuracy  or 
less  costly  errors.  Even  thinking  about  a  new  theory  may  be  costly  (see 
Shugan,  I9§3)»  People  will  rightly  settle  for  a  “satisficing**  theory  Cane 
that  yields  results  that  are  good  enough  to  satisfy)  rather  titan  seeking 
for  an  optimal  theory. 

Sclent  if  1ft  theories, 

Science  is  true.  Don't  be  misled  by  the  facts. 

finagle '$  Creed 

Progress  does  not  consist  in  replacing  a  theory  that  is 
wrong  with  one  that  is  right.  It  consists  in  replacing  a 
theory  that  is  wrong  with  one  that  is  sore  subtly  wrong, 

Siskin's  Theory  of  Progress 
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Scientists  are  no  exception  to  the  tendency  to  persevere  in  believing  a 
theory  despite  contradictory  data.  There  are  good  reasons  for  this 
scientific  conservatism.  Data  are  often  poorly  generated,  falsely 
interpreted,  or  otherwise  invalid.  Scientists  rightly  view  new, 
inconsistent  data  with  more  skepticism  than  they  do  old  trusted  theories 
(Folanyi,  1958). 

Mitroff  (1974)  interviewed  40  NASA  scientists  and  found  a 
surprising  number  were  highly  committed  to  confirming  their  own 
theoretical  positions  and  saw  this  commitment  as  necessary  and  desirable. 
They  argued  that  without  it,  many  good,  new,  but  undeveloped  ideas  would 
die  as  a  result  of  premature  falsification.  Those  scientists  who  held 
such  views  tended  to  be  those  who  were  rated  by  peers  as  especially 
successful  and  prominent. 

Scientists  often  believe  they  should  not  drop  a  theory  on  the 
basis  of  a  few,  stray  questionable  facts,  but  only  in  the  face  of  a  large, 
consistent,  interpretable  body  of  data.  In  effect,  a  theory  is  kept  until 
a  competitor  theory  develops  to  the  point  that  it  can  replace  the  first 
theory.  Scientists  try  to  protect  themselves  from  over-reacting  to  new 
facts  that  may  turn  out  to  be  in  error.  Francis  Crick,  discoverer  of  the 
structure  of  DSA,  observed  (Crick,  1979): 

Misleading  data,  false  ideas,  problems  of  personal 
interrelationships  occur  in  much  if  not  all  scientific  work 
.  »  .  [when  the  double  helix  was  discovered)  I  think  we 
realised  almas*  immediately  that  we  had  stumbled  onto 
something  important  ...  I  recall  going  home  and  telling 
my  wife  Odie  that  we  seemed  to  have  made  a  big  discovery. 

Tears  later  she  fold  m  that  she  hadn't  believed  a  word  of 
it,  “Teu  were  always  coming  home  and  saying  things  like 
that,**  she  said,  “so  natural ly  X  thought  nothing  of  it.“ 

How  then  does  new  data  ever  become  accepted  as  tact?  The 
evaluation  of  new  data  in  science  is  a  social  endeavor  in  which 
epistemological  purity  tea  teats  little,  and  anticipating  objections  and 
raising  the  costs  of  disagreement  e*vnt  for  much,  Scientists  carry  oaf 
experiments  to  “test*  new  data  bv  broadening  and  refining  the  contests  in 
which  the  facts  are  true*  Facts  are  accepted  as  tush  because  of  the 
specific  conditions  under  which  they  were  created,  hut  in  besoming  tacts 
they  are  stripped  of  reference  to  context  and  deemed  equally  true  for  ail 
situations  (Searman,  1979),  Scientific  facta  are  socially  invented  by  the 
eomornunity  efforts  of  scientists,  The  seeming  discovery  of  facts  is  a 
social  creation j  it  is  an  illusion  that  scientific  tacts  are  found  without 
the  active  involvement  of  social  processes  that  interrelate  scientists  and 
scientific  thought. 

All  cognition  and  perception  of  a  scientific  finding  occur  in  a 
particular  thought  style  which  is  developed  among  scientists,  what  fleck 
termed  a  “thoughtful  collective-  (|0§),  Many  of  the  biases  of  theory 
change  and  maintenance  that  afreet  laymen  Seem  also  to  affect  scientists 
because  scientists  are  also  dependent  on  a  social  basis  of  knowledge,  and 
everything  the  scientist  needs  tn  know  cannot  be  known  scientifically. 
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Thus,  while  conservatism  protects  theories  from  being  rejected  by 
erroneous  data,  it  also  leads  some  scientists  to  hold  theories  long  after 
other  scientists  have  accepted  data  which  support  a  better  theory  (Kuhn* 
1970;  Mahoney,  1976;  1977), 

These  empirical  and  social  findings  on  the  beliefs  and  practices 
of  scientists  contrast  with  widely  accepted  views  on  the  appropriate 
strategies  for  testing  theories  and  hypotheses.  These  normative  views  of 
scientific  inference  specify  disconf irmation  and  tests  of  multiple 
alternative  hypotheses  as  the  major  strategies  (Platt,  1964;  Popper » 
1962).  Popper's  entire  philosophy  of  science  is  built  on  the  concept  of 
disconf irmation.  Platt  has  proposed  that  scientists  construct  experiments 
and  tests  to  disconf irtn  successive  generations  of  alternative  hypotheses. 
He  labels  this  method  "strong  inference."  Not  only  do  laymen  not  follow 
this  normative  advice  on  theory  testing,  neither  do  many  scientists. 

Theories  and  evidence.  In  the  section  above  on  "assessing 
covariations"  we  noted  how  people  overestimate  the  strength  of 
theory-driven  correlations,  to  the  degree  that  correlation  is  perceived 
where  none  exists.  Theoretical  illusory  covariations  were  almost 
impervious  to  contrary  evidence,  e.g.,  data  that  were  strongly  and 
negatively  correlated  only  slightly  reduced  beliefs  that  the  data  covaried 
positively.  Psychologists  have  found  that  covariation  theories  are  not 
alone  in  being  relatively  immune  to  contradictory  evidence.  Studies  of 
theory  formation  and  changes  support  four  conclusions  (Nisbott  and  Ross , 
1980;  Ross  and  Anderson,  1980;  Ross  and  Lepp@r,  1980);  (1)  Preexisting 
theories,  when  exposed  to  probative  evidence  (whether  supporting  or 
opposing  the  theory),  tend  to  be  held  correct  to  a  greater  degree  than  the 
evidence  warrants.  (2)  When  people  form  a  theory  on  the  basis  of  new 
evidence,  the  new  theory  resists  disconf irmation  by  subsequent  evidence. 
(3)  If  evidence  that  forms  the  basis  for  a  theory  is  demonstrated  to  be 
false,  people  nevertheless  will  continue  to  believe  the  theory  is  still 
true.  (4)  People  are  able  to  find  or  create  evidence  to  support  any 
theory  they  believe, 

Maintaining  existing  then? las,  People  with  a  pre-existing  theory 
or  beliei  'Wisat  ^w  evileneiT^ni:'!highly  biased  mmst.  Evidence  which 
eonfirsi  their  theory  is  accepted,  the  method  that.  pto-ioced  the  evidence 
ir  deeded  sound,  and  belief  in  the  theory  in  reinforced  by  the  evidence, 
Evidence  which  contradict*  the  theory  is  nut  accepted,  the  isethodology 
which  generated  the  evidence  is  strongly  etmiK-eged,  and  despite  the 
negative  evidence,  belief  in  the  theory  is  increased  (Lord,  Sues,  and 
tapper,  1979)*  In  other  word*,  belief  la  a  theory  aay  bo  greater- after 
reading  negative  evidenea  than  after  reading  ns  evideaeo*  SKffassafc 
standards  are  applied  to  research  embeds  when  they  yield  evidence  that 
opposes  m  accepted  theory- -fitas  wbsa  their  evidence  eenfi tm  the  theory, 
turd,  *t  ai»,  <19793  also  found  chat  siswd  evidence,  which  support* 
opposing  -theories  equally,  does  mt  .r^duea  eenfidwnss  in  theories  hot 
instead  reinforces  the  coni  ids  non  of  those  Holding  either  view., 
ixpeclsentai.  roeults  in  with  r  he  accepted,  theory  wore  rated 
“war#  ewflvinfeiof*  and  the  studios  '’bettor'  oo-aduerod"  thgsn  re-suits  and 
studies  which  contradicted  the  theory,  vrrga  idles*  .of  the  netheds  of  the 
studies. 

One  of  .the  best  instances  Of  «i*cd  ovidwue®  feottdlttg  to-  Goaf  St* 
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differing  theories  can  be  found  in  the  interpretations  by  naval  analysts 
of  Admiral  Gorshkov ‘s  articles  and  book  (see  chapter  3,  case  4). 
Gorshkov's  many  opinions  can  and  have  been  taken  to  support  a  wide  variety 
of  views  on  the  Soviet  Navy's  future.  Kather  than  weakening  an  analyst's 
beliefs  in  his  theory  of  Soviet  Navy  peacetime  developments,  the  Gorshkov 
papers  seem  only  to  strengthen  them.  Analysts  seem  quite  adept  at 
interpreting  Gorshkov  as  opposing  the  theories  the  analyst  opposes  and 
supporting  the  theories  the  analyst  supports 


False  consensus  bias.  People  often  judge  the  need  for  explanation 
by  reference  to  themselves;  if  someone  els*  acts  much  as  we  do,  wc  see 
little  need  for  a  special  theory  to  explain  the,' r  behavior.  In  general, 
people  are  prone  to  assume  that  their  own  behavior  or  beliefs  are  quite 
common  and  needing  little  specie*  explanation.  Furthermore,  when  others 
act  or  bolieve  as  we  do,  there  is  no  urgent  need  to  explain  their 
behavior.  When  other's  behaviors  or  beliefs  are  different  from  our  owu, 
however,  there  is  a  strong  motivation  to  consider  various  theories  to 
explain  the  differences  (Hess,  Greene,  and  House,  197?).  Since  people 
overestimate  the  commonness  of  their  own  beliefs  and  behaviors,  they  tend 
to  be  surprised  by  the  different  behaviors  and  beliefs  of  others,  and  view 
these  as  more  significant  and  uncommon  than  they  are.  People  also 
underestimate  the  significance  of  beliefs  or  behaviors  'similar  to  their 
own,  tend  to  overestimate  how  common  they  are,  and  assume  they  occurred 
for  the  some  reasons. 

Moore,  Flanigan,  and  Helsel  ($NI {  eh.  7)  suggest  that  in  the 
period  1956-1966,  naval  analysts  misinterpreted  the  Soviets'  motivations 
for  constructing  missile  submarines  and  misread  Soviet  missile  submarine 
operations  as  being  similar  to  Western  motives  and  operations.  Since  the 
Soviet  and  Western  submarines  seotaed  similar,  analysts  assumed  that  they 
were  intended  for  similar  missions,  Moore,  at  a),,  argue  that  the  Soviet 
submarines*  tusd  quite  a  different  mission  of  <tnti~*hlp  attack,  and  did  not 
share  the  strategic  deterrent  role  of  Astern  missile  submarines*  they 
wrote  of  the  episode  Cp»  140)1 

Apparent  mismatches  between  technical  parameters  and 
operational  employment  *  aa  well  as  anfcmingly  fmesplf cable  . 
Soviet  psomouneemeatx ,  often  eaw&fc. itestem  analysts  little 
concern,  m  long  there  Is  possible  a  image*  m 

*1the“way‘*wuB‘du^i.5;‘'  interpretation  ,&i  she- data, 

theory,  jocist I on ,  the  fart  Shat  s-Wones  are  so  useful  in 
.  o t garni tt of 4 rhrnndi.ng  streams  of  eew  data  to  lead  people  ta 
apply  t&mtim  prematurely,  Since  th§«*-ies.  ate  .relatively  insensitive  to 
diseftftf irrntng  evidence  and  highly  senaiti to  ranfirmitig  evidence, 
theories  farmed  early  may  gather  strength  tan  quirk ly  and  became 
1  $t$«f f icie.nt iy  sensitive  tc*  s-uh^equen-.t  negative  data,  People  becasw 
prematurely  s&e&J&twi  to  a  tho.nry  and  w&able  ta  revise  it  appropriately  as 
'  further  is  obtained* 

People  test  a  hypothesis  ft*?*' a' new  theory  by  trying  to  confirm 
it,  i,«„  leofeing  for  evidence  consistent,  with  the  hypethosis  and  the 
theory,  rather  than  by  looking  £&£  evidence  that  would  refute  the 
hypothesis,  this  strategy  allows  people  to  determine  which  hypotheses 
Work,  but  M-%  which  ore  valid*  by  overlooking ’negative  Information  they 


in 


! 


are  unable  to  efficiently  reject  hypotheses  and  theories.  There  are 
ecological  reasons  why  people  have  this  tendency  (which  are  related 
below),  but  tills  does  not  lessen  the  fact  that  confirmation  is  a  weak, 
testing  strategy. 

An  experiment  by  Mason  (1960)  demonstrated  this  tendency.  Mason 
asked  people  to  guess  the  rule  generating  a  series  of  numbers.  The  first 
numerical  example  given  was  “2  .  .  .  4  .  .  .  6.'*  People  guessing  the  rule 
could  generate  any  series  of  numbers  they  liked  and  could  ask  if  the 
series  fit  the  rule  or  not.  Host  people  generated  examples  consistent 
with  the  most  common  guess,  that  the  rule  was  ‘"ascending  consecutive  even 
numbers."  Pew  people  generated  inconsistent  or  dlseonf i'rming  examples, 
and  few  guessed  the  aetual  rulet  "any  ascending  series."  People  tended 
to  confirm  the  rule  they  thought  to  be  correct,  and  did  noc  attempt  to 
refute  incorrect  hypotheses. 

A  series  of  studies  by  Mynntt,  Doherty  and  Tweney  (19??,  1978; 
Doherty,  Mynatt,  Tweney,  and  Schiavo,  15?9;  Tweney,  Doherty,  Morner, 
Pilske,  and  Hynatt,  1980)  have  revealed  (»)  a  strong  tendency  to  use 
confirming  strategies  and  nut  use  disconfirmacion,  (b)  an  ability  to  use 
explicit  falsifying  evidence  when  available  to  correctly  reject  wrong 
hypotheses  in  simple  problems,  (c)  difficulty  in  using  discoufirmation  or 
multiple  hypothesis  testing  strategies  in  complex  problems,  and  (d) 
tendencies  to  seek  information  of  no  diagnostic  value.  In  analyzing  a 
simple  "artif ical  universe"  people  consistently  tended  to  confirm 
hyutheses,  but  if  explicit  diseonfiematory  evidence  was  obtained  it  was 
used  to  reject,  false  hypotheses.  In  assessing  *  more  cample*  "artificial 
universe"  people  had  great  difficulty  employing  a  diseonf iroacion  strategy 
or  diseonf iteration  evidence.  SNvcia'iy  correct  hypotheses  were  often 
eompletely  rejected  because  of  diaernf iming  data.  A  mixed  strategy  of 
eonf inflation,  diseaoi irmatien,  replication,  and  experimental,  variation 
seemed  to  yield  the  best  results.  The  testing  of  multiple  alternative 
hypotheses  seemed  to  impose  a  debilitating  cognitive  strain  while  the 
strategy  of  considering  two  related  hypotheses  at  a  time  led  to  much 
improved  performance * 

Tweney,  et  ai . ,  (1180)  note  that  disconfireation  is  likely  to  be¬ 
an  efficient  strategy  only  aster  several  “good"  working  hypotheses  have 
beast  determined  by  means  of  confirmation.  Maeonf  1  t ion  also  requires 
that  the  diaaenf Itmd  ease  be  analysed  as  fully  as  passible,  hospie  tend 
to  treat  disconf irmatitns  m  negative  information,  i.e.,  they  largely 
ignore  it.  Similarly,  in  testing  multiple  hypotheses,  people  may  use 
information  on  the  one  “real"  hypothesis,  and  Ignore  information  on  the 
other  "dummy"  hypotheses ,  The  strategy  of  multiple  hypothesis  testing  and 
diseoftf Irmation  may  be  epistemologically  efficient,  but  cognitively  very 
difficult  to  perform . 

In  a  series  of  studies  on  the  ability  a*  people  to  test  hypotheses 
about  others,  Snyder  and ‘colleagues  found  i Snyder »  l^?i;  Snyder  and 
Cantor*  l%li|  imyiet  and  fe.ngestad,  litfj  Snyder  and  Swann*  iWla,  b)  that 
people  systematically  formulate  and  carry  out  confirmatory  strategies  and 
gather  evidence  that  tends  to  support  the  hypothesis  under  ^mamina tion, 
Mypothesis^discoMirmiftg  strategies  are  not  formed,  and  people  make  little 
use  of  dlssonf irmlng  evidence  These  tendencies  led  to  a  readiness  to 
accept  whatever  hypothesis  was  under  test. 

There  seem  to  we  several  cognitive  processes  that  combine  to 


s 

produce  this  confirmation  bias  in  theory  testing*  People  tend  to 
recognize  the  relevance  of  confirming  evidence  wore  readily  than  that  of 
disconfiroing  evidence,  and  therefore  can  more  readily  search  for  and 
detect  confirming  data  (Wason  and  Johnson-laird,  196$).  In  searching 
memory  for  relevant  evidence,  people  are  more  likely  to  recall  confirming 
than  disconfiroing  evidence  (Snyder  and  Cantor,  1979), 

These  tendencies  arc  probably  closely  related  to  the  tendency  to 
overemphasize  the  frequency  of  "positive  hits"  in  the  four-fold, 
present -'absent  table  in  assessing  covarations  (see  above).  The  entries  in 
the  +4-  cell  are  much  more  likely  to  influence  such  assessments  chan  the 
entries  in  the  other  cells.  The  ++■  entries  are,  of  course, 
confirmations. 

Given  the  strength  of  the  confirmation  bias  it  is  not  surprising 
to  find  that  in  our  sample  of  estimates  by  naval  analysts  only  two  essays 
made  use  of  an  explicit  multiple  hypothesis  and  disconf irmation  approach. 
Many  papers  comment  briefly  an  alternative  hypotheses  and  then  quickly 
discard  them,  usually  on  the  basis  of  one  or  two  items  of  contrary 
evidence.  The  hypothesis  that  is  accepted  may  also  face  contrary 
evidence,  hut  this  is  usually  "explained, *  rationalized,  or  otherwise 
reinterpreted  by  the  analyst  so  that  it  does  little  or  no  damage  to  the 
hypothesis.  In  contrast,  Kelly  (Sh’P,  ch.  15)  and  blechman  and  Levinson 
(SN1,  ch.  22)  explicitly  test  a  body  of  evidence  against  a  variety  of 
competing  hypotheses.  A  paper  by  Horde  (|W,  eh.  8)  takes  a  traditional 
but  more  explicit  approach,  i  .e. ,  one  hypothesis  is  considered  but  the 
evidence  pro  and  con  is  described  and  evaluated,  in  contrast,  Kell),  lists 
four  hypotheses  to  explain  a  particular  Soviet  action  and  lists  the 
evidence  for  and  against  each  one*  This  ts-'ds  to  underline  the  degree  to 
which  one  piece  of  evidence  may  confirm  several  hypotheses  an-,  also 
discomfit®  several  others,  hi eehman  and  Levinson  hypothesize  six 
different,  reasons  for  a  Soviet  action  and  organize  evidence  for  each, 
rejecting  most  a.s  the  primary  explanation  for  the  Soviet,  action,  and 
leaving  one  as  a  strong  candidate,  and  two  as  possible*  partial 
motivations , 

This  is  not  Co  say  that  other  naval  analysts  do  not  consider 
multiple  hypotheses  or  assess  hypotheses  equally  against  the  accumulated 
positive  and  negative  evidence.  To  some  degree,  all  analysts  do  some 
multiple  hypothesis  diseenfirmtien*  what  m  are  pointing  out*  however, 
ace  the  strong  tendencies  not  m  do  this  and  nut  to  d@  it  explicitly,  it 
is  far  too  easy  to  dlsennfitm  hypotheses  one  does  not  believe  in,  and  to 
confirm  hypotheses  one  already  accepts,  especially  if  on#  relies  @n 
lof&iMl  or  ad  hee  #enf icmation-distoafitmacinn  gcoc#d«fs§«  Analysts 
would  he  far  better  off  explicitly  stating  the  various  possible  hypotheses 
and  listing  the  pro  and  con  arguments*  as  Sally  does*  than  in  leaving,  such 
comparisons  largely  implicit  and  loosely  related*  as  is  sate  typically 
dune.  Analyses*  would  also  be  better  able  to  tpeeify  the  degree  of  support 
a  set  of  data  give  a  hypothesis,  and  the  degree  to  which  several 
hypotheses  remain  viable  given  some  data  set,  by  si  marly  specifying  the 
hypothesis-data  relationships.  This  would  also  allow  the  analyst  to 
better  assess  th#  level  of  confidence  he  or  she  should  have  in  any  one 
hypothesis.  A  failure  to  explicitly  list  all  points  of  evidenee 
inconsistent  with  hypotheses  seems  to  be  one  primary  cause  of 
overcoat ideftee  in  judgments  (see  beldvj. 

HO 


Perseverance  of  discredited  theories.  Quite  of  tea  theories*  are 
famed  on  ' c he  "’bus is" a|; m' ‘data  uhi eh  "is  later  discredited.  That  is,  later 
evidence  is  obtained  which  clearly  demonstrates  that  the  earlier  data  were 
incorrect,  in  this  case,  the  theory  based  on  the  discredited  data  should 
be  s ignis leant ly  modified,  it  not  abandoned  altogether.  Psychologists 
find,  however,  that  such  medif icatieo  is  typically  very  slight,  and  such  a 
theory  survives  discrediting  evidence  largely  intact, 

Hess  and  topper  Stave  investigated  what  happens  to  beliefs  when 
their  entire  evideneiary  basis  is  totally  discredited  (Rosa,  tapper,  and 
Hubbard,  1979;  tapper,  Hess,  and  tau,  1979;  AaduesoR,  hopper,  and  Ross, 
1979).  they  find  that  beliefs  and  theories  persist  after  the  basis  for 
the  beliefs  is  shown  to  be  valueless.  Par  example,  Anclarson,  hopper,  and 
Ross  (1979)  requested  people  to  explain  either  a  relationship  between  a 
prognostic  variable  (risk  preference  an  a  paper  and  pencil  test)  and 
success  or  failure  a®  a  firefighter.  One  group  was  given  a  ease  study 
that  suggested  a  positive  relationship  between  risk  preference  and  success 
and  a  second  group  received  a  case  study  suggesting  a  negative  relation, 
After  the  people  gave  their  explanations  of  the  relation,  they  learned 
that  the  case  study  was  totally  fictitious  and  that  others  had  been 
exposed  to  the  opposite  relation,  bespits  the  discrediting  of  tint  basis 
of  their  explanations,  peoples’  beliefs  in  the  accuracy  of  their 
explanations  remained  high,  and  they  insisted  that,  notwithstanding  the 
discrediting,  it  was  obvious  that  the  particular  relationship  they  had 
explained  was  the  correct  one.  Several  expressed  surprise  chat  people  in 
the  ether  group  had  been  so  gullible  as  m  accept  the  opposite  relations 
as  possible. 

It  is  quite  difficult  to  assess  the  degree  to  which  the  theories 
of  naval  analysts  are  resistant  to  the  discrediting  of  earlier  evidence. 
Information  on  the  Soviet  Rauy  is  constantly  being  modified,  weapons 
systems  thought  initially  to  bs  anti“Ship  later  to  bo  recognised  as 
anti-submarine,  estimates  »f  weapons*  ranges  expand  and  contract  as 
additional  data  are  obtained,  estimates  of  Soviet  tactics  and  doctrines 
are  modified  as  Soviet  exercises  and  deployments  are  studied,  patterns  of 
Soviet  deployments  and  construction  reveal  unexpected  plans  or  motives, 
tthather  these  changes  in  the  data  base  produce  appropriate  changes  in 
analysts*  estimates  is  impossible  to  adequately  address  in  a  genet*.  1  study 
such  a$  this.  Analysts  almost  never  describe  exactly  haw  their  estimates 
change  when  they  learn  that  a  previously  accepted  “face'’  was  actually  in 
error, 

Analysts  #@*  however,  update  their  estimates,  IPs?  example,  Hudson 
CJ|@-  tit)  concluded  tin  a  1PI-  essay)  shat  lovlet  naval  doctrine  "oven 
apps©M«atsd  94»  doctrine**  and  the  Soviet  fleet  "would  be  developed  along 
the  same  lines  as  the  American."*  A  few  years  later  Hudson  §S) 
explicitly  reversed  his  earlier  estimates,  concluding  that  Soviet  doctrine 
^reflects  a  distinct  view  of  naval  utilisation,  differing  in  important 
respects  from  current  Western  thinking,**  a  degree  Hudson  argues  that 
Soviet  thought  on  these  issues  had  shifted,  but  he  also  seems  to  suggest 
that  his  own  thinking  nad  changed,  but  it  is  not  clear  exactly  why , 

Perhaps  the  hast  example  in  our  sample  «f  explicit  updating  M 
estimate*  $#  hceSwire**  ttijg ,  eh,  I#)  essay  on  the  evolution  of  Soviet 
naval  pulleys  !§§§-Mj  ntc§wSr«  expands  his  estimate*  that  Soviet 
forward  deployment  was  due  to  strategic  defensive  needs,  to  include 
evidence  that  the  dev let  Racy  was  playing  a  greater  rule  in  inhibiting  the 
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U.S.  Navy  power  projection  in  peacetime  (cf.  p.  520).  MccGwire  makes 
clear  that  his  estimate  had  changed  in  response  to  new  evidence  and  a 
better  understanding  of  ongoing  trends  (p.505).  He  also  attempts  vo 
specify  the  degree  to  which  his  previous  estimate  remained  intact,  putting 
the  two  hypotheses  of  strategic  defense  and  forward  peacetime  power 
projection  into  a  relative  perspective.  It  is  also  clear  that  other  naval 
analysts  would  not  agree  that  MccGwire  has  sufficiently  adjusted  his 
estimates  in  light  of  these  new  data  (see  chapter  3,  cases  5,  8,  and  9). 
Of  course,  in  responding  to  his  critics*  charges  that  he  had  not  modified 
his  old  theories  enough,  given  the  new  evidence,  MccGwire  could  respond 
that  his  critics  have  gone  too  far  in  accepting  early  returns  as 
supporting  their  new  theories,  and  have  failed  to  consider  adequately  that 
part  of  the  new  evidence  that  also  fits  the  older  theories. 

Overconfidence .  Accumulating  research  on  judgment, 
decision-making,  and  probability  estimation  shows  a  substantial  lack  of 
ability  of  both  experts  and  nonexperts.  However,  people  have  great 
confidence  in  their  fallible  judgment.  People  believe  their  theories, 
judgments,  and  estimates  are  correct  far  more  than  they  actually  are; 
people  are  more  confident  than  they  are  accurate  (Lichtenstein,  Fischhoff, 
and  Phillips,  1976;  Fischhoff,  Slovic  and  Lichtenstein,  1977).  Typically, 
for  example,  when  people  state  their  subjective  probability  of  being 
correct  is  .70,  the  relative  frequency  with  which  they  are  correct  is  only 
60  percent;  when  they  are  90  percent  certain,  they  are  only  right  75 
percent  of  the  time,  and  so  on  . 

Fischhoff,  et  al.,  (1977)  suggest  several  reasons  why  confidence 
exceeds  accuracy.  As  people  estimate  au  answer,  they  are  forced  to  reason 
from  the  known  to  the  unknown.  As  we  have  seen  repeatedly  in  this 
chapter,  people  are  insufficiently  critical  of  their  inference  processes. 
They  may  fail  to  adjust  their  confidence  levels  to  reflect  weak 
assumptions,  or  problems  with  their  own  reasoning  processes.  People  use 
inferential  strategies  almost  automatically  and  unconsciously  and  give 
little  thought  to  the  logical  steps  required.  We  have  noted  how  people 
perform  many  of  these  steps  improperly  or  incompletely,  while  assuming 
they  have  done  them  correctly.  Since  the  validity  of  tfte  interence 
process  is  assumed  to  be  virtually  perfect,  the  product  of  the  process  is 
assumed  to  be  correct. 

People  also  believe  their  memories  are  exact  copies  (although 
faded  or  incomplete)  rather  than  reconstructions  of  experience.  Rarely 
are  the  biases  of  memory  storage,  reconstruction,  and  retrieval  adequately 
considered  by  the  individual  when  discounting  confidence.  The  weakness  of 
such  memorial  processes  as  eyewitness  testimony  are  we 11 -documented  (e.g., 
Buckhout,  1974;  Loftus,  1974)  but  eyewitnesses  themselves  rarely  question 
their  capabilities  to  report  what  they  saw. 

People  may  begin  solving  an  estimation  problem  by  referring  to 
their  theoretical  knowledge  and  adjusting  their  estimates  from  a 
theoretical  baseline  by  an  amount  that  reflects  any  new  information. 
Tversky  and  Kahneman  (1974)  have  found  that  such  adjustment  tends  to  be 
too  conservative;  people  fail  to  adjust  their  estimates  from  the  anchoring 
point  of  theory  sufficiently  to  reflect  new  data.  The  range  of  apparent 
possible  answers  is  thus  likely  to  be  narrower  than  it  actually  is,  and 
people  may  be  overconfident  that  their  theory-anchored  inference  process 
considered  an  adequately  wide  band  of  possibilities. 


Complex  inferential  problems  may  be  broken  up  and  processed 
serially,  a  piece  at  a  time.  In  doing  so,  people  may  ignore  the 
uncertainty  inherent  in  their  solutions  for  early  parts  of  the  problem. 
This  will  reduce  the  cognitive  strain  in  dealing  with  later  parts.  Rather 
than  setting  their  confidence  limits  in  accordance  with  the  .least  accurate 
or  certain  part,  people  may  average  confidence  levels  for  the  various 
parts,  or  adopt  the  highest  confidence  level. 

Lichtenstein  and  Fischhoff  (1977)  examined  the  confidence  of 
experts  and  nonexperts  in  terms  of  calibration  and  resolution.  The 
perfectly  calibrated  estimator  assigns  confidence  probabilities  that 
accurately  reflect  the  proportions  of  correct  answers.  For  example,  when 
the  perfectly  calibrated  estimator  gives  a  confidence  rating  of  .75,  three 
out  of  four  times  the  estimator  is  correct.  Resolution  reflects  the 
ability  of  the  estimator  to  discriminate  those  items  he  or  she  is  more 
likely  to  correctly  answer  from  those  he  is  less  likely  to  get  correct. 
Experts  were  less  overconfident  than  nonexperts,  but  the  best  experts 
showed  some  underconf idence;  i.e.,  experts  were  better  calibrated  than 
nonexperts  but  not  perfectly  calibrated.  Experts  were  not  better  at 
resolution  than  nonexperts,  and  seemed  largely  insensitive  to  how  much 
they  did  or  did  not  know.  As  Lichtenstein  and  Fischhoff  noted,  the  reason 
experts  were  better  calibrated  than  nonexperts,  despite  being  no  better  at 
resolution,  is  simply  that  experts  got  more  items  correct,  and  their 
overall  accuracy  more  closely  matched  their  overall  confidence  level. 
Lichtenstein  and  Fischhoff  (1980)  found  some  improvement  in  calibration 
with  feedback  training  on  related  tasks,  but  very  little  evidence  of 
generalization  to  different  tasks. 

Another  promising  approach  to  improving  calibration  of  confidence 
judgments  is  sensitivity  testing.  Koriat,  Lichtenstein,  and  Fischhoff 
(1980)  required  people  to  list  the  reasons  for  and  against  each  of  the 
responses,  they  chose.  The  people  then  estimated  the  probability  they  were 
correct.  This  procedure  forces  people  to  consider  reasons  why  their 
answers  might  be  incorrect.  This  sensitivity  test  produced  marked 
improvements  in  the  calibration  of  confidence  judgments.  In  a  subsequent 
study  Koriat,  et  al.,  found  that  only  the  listing  of  contradicting  reasons 
(i.e.,  reasons  why  an  answer  might  be  wrong)  improved  the  calibration  of 
confidence.  These  results  suggest  that  confidence  judgments  tend  to 
reflect  the  amount  and  strength  of  evidence  in  favor  of  the  selected 
answer,  and  tend  to  neglect  contradictory  and  disconf irming  evidence.  In 
view  of  the  difficulty  people  have  in  perceiving  and  retrieving 
disconf irming  evidence  when  testing  hypotheses  (see  above),  it  is  not 
surprising  that  disconfirmlng  evidence  has  little  impact  on  confidence 
judgments  unless  people  are  specifically  required  to  consider  it. 

Einhorn  and  Hogarth  (1978),  in  their  review  of  overconfidence  and 
the  "illusion  of  validity"  of  predictions  (see  above),  also  conclude  that 
the  difficulty  people  have  in  using  disconf irming  information  to  test 
hypotheses  prevents  people  from  obtaining  the  positive  and  negative 
feedback  from  experience  that  would  reduce  overconfidence.  They  note  two 
other  factors  that  increase  the  difficulty  of  learning  from  experience  to 
make  more  accurate  judgments:  lack  of  awareness  of  environmental  effects 
on  outcomes  (e.g.,  regression  effects,  base-rates),  and  the  use  of  unaided 
memory  for  coding,  storing,  and  retrieving  outcome  information. 


overconfident  in  the  accuracy  of  their  answers  when  answering  knowledge 
questions,  estimating  numerical  values,  or  judging  probabilities.  Dawes 
(1980)  has  found  that  people  are  not  overconfident,  however,  when  making 
perceptual  judgments  but  were  when  making  intellectual  judgments.  He 
found  that  psychologists*  recollections  of  the  eye  colors  of  colleagues 
did  not  reflect  any  appreciable  overconfidence,  while  the  answers  of  the 
same  psychologists  on  a  test  of  psychology  and  general  knowledge  items 
reflected  considerable  overconfidence,  i.e.,  average  assessed  confidence 
was  .80  while  the  percent  correct  was  .70  for  the  knowledge  items,  but  .67 
and  .75  respectively  for  the  eye  color  perceptions.  Perceptual  tasks 
produced  the  least  average  confidence  and  the  greatest  average  accuracy, 
while  the  intellectual  tasks  produced  the  highest  average  confidence  and 
the  lowest  average  accuracy.  Dawes'  study  is  a  replication  of  the 
Lichtenstein  and  Fischhoff  (  1977)  finding  that  resolution  is  generally 
poor,  and  people  do  not  distinguish  those  types  of  items  for  which  they 
are  more  accurate  (e.g.,  perceptual  tasks)  from  those  on  which  they  are 
less  accurate  (intellectual  judgments). 

Dawes'  results  also  seem  consistent  with  Einhom  and  Hogarth's 
(1978)  analysis  of  conditions  that  lead  to  overconfidence.  That  is, 
people  probably  have  greater  experience  with  perceptual  illusions  and 
evidence  that  disconfirms  their  own  perceptions  than  they  have  with 
cognitive  inferential  illusions.  People  are  probably  more  accustomed  to 
checking  the  validity  of  their  perceptions  (e.g.,  by  changing  the  vantage 
point,  using  a  different  sense  modality,  increasing  the  base-rate  by 
obtaining  a  better  look  or  a  second  opinion,  etc.)  than  they  are  at 
checking  the  validity  of  their  logical  inferences.  Secondly,  people  are 
probably  much  more  familiar  with  the  effects  of  environmental  factors  on 
perceptions  than  they  are  with  the  effects  of  environmental  factors  on 
inferences  and  predictions.  People  readily  understand  how  their 
perceptions  may  be  distorted  by  environmental  factors  (e.g.,  haze, 
ophthalmic  weaknesses)  but  seem  to  have  no  appreciation  of  the  effects  of 
such  environmental  factors  as  regression,  base-rates,  treatment  and 
•placebo  effects,  and  probabilistic  independence  and  dependence  on 
intellectual  judgments.  Finally,  it  seems  likely  that  human  memory  is  at 
least  as  adequate  for  coding,  storing  and  retrieving  data  on  perceptions 
(e.g.,  "when  I  recognize  a  face  is  it  usually  someone  I  have  met 
before?"),  as  it  is  for  information  on  intellectual  judgment  outcomes 
(e.g.,  "when  I  recognize  a  face  do  I  usually  associate,  the  correct  name 
with  it?"). 

Learning  from  experience.  The  review  by  Einhorn  and  Hogarth 
(1978)  implies  people  will  tend  not  to  learn  from  experience  that  their 
theories  and  hypotheses  are  wrong.  People  will  thus  continue  to  have 
confidence  in  weak  or  fallacious  theories  because  of  the  difficulty  they 
have  in  developing  evidence  from  experience  to  test  their  theories. 
Einhorn  and  Hogarth  (1978)  and  Brehraer  (1980)  suggest  that  the  experiences 
people  have  with  their  theories  facilitate  the  operation  of  biases  which 
prevent  learning:  the  tendency  to  use  confirmatory  evidence,  disregard  of 
negative  information,  and  assumptions  about  causality.  Brehmer  argues 
that  people  tend  to  confirm  hypotheses,  for  example,  because  it  is  rarely 
clear  what  dimensions  of  a  problem  are  important,  nor  what  boundaries 
distinguish  one  concept  from  another  (i.e,,  hypotheses  are  "fuzzy  set" 
concepts).  Learning  that  a  concept  fits  the  data  may  be  the  only  useful 
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increment  in  information  the  environment  allows,  while  an  attempt  to 
disprove  a  hypothesis  may  fail  because  of  the  difficulty  in  specifying 
exactly  what  the  hypothesis  allows  or  does  not  allow.  Negative 
information  is  far  more  useful  in  laboratory  experiments,  where  the 
boundaries  and  dimensions  of  concepts  and  hypotheses  are  clear-cut.  In 
the  "real  world"  of  fuzzy  concepts,  being  told  the  Soviets  do  not  practice 
sea  control  may  not  be  as  useful  as  being  told  they  do  practice  sea 
denial.  Learning  that  a  Soviet  action  is  not  representative  of  sea 
control  will  be  less  interesting  than  the  hypothesis  that  an  action  "fits" 
the  sea  denial  concept. 

This  does  not  mean  that  naval  analysts  should  avoid  using  negative 
evidence  or  disconf irming  strategies  for  testing  theories.  It  does  mean 
that  real  world  hypotheses  must  be  carefully  conceptualized  for  such 
methods  to  be  useful.  There  are  means  by  which  fuzzy  concepts  can  be 
distinguished  more  clearly  (chapter  5).  Given  the  difficulty  of  drawing 
distinctions  and  the  absence  of  disconf irming  strategies  analysts  should 
be  aware  of  the  inherent  weakness  of  confirmatory  strategies,  and  attempt 
to  supplement  them  when  possible, 

Brehmer  also  notes  that  people  must  supply  the  hypothetical 
realtionships  between  concepts  and  that  hypotheses  generation  tendencies 
are  often  inappropriate  for  judgment  tasks.  That  is,  people  assume  that 
the  rules  relating  concepts  follow  the  pattern: 

.  .  .  there  is  a  rule,  rather  than  that  there  is  no  rule, 
that  this  rule  is  deterministic,  rather  than  probabilistic, 
that  the  values  to  be  predicted  from  the  cue  values  do  in 
fact  depend  on  the  cue  values,  .  .  .  that  the  rule  is 
functional  .  .  that  the  rule  is  a  positive  linear  function. 
(Brehmer,  1980:  231). 

This  pattern  fits  peoples’  experiences  with  psychophysical  stimuli; 
sensation  usually  is  a  positive  function  of  the  stimuli  (in  fact,  a  log 
function,  e.g.,  Fechner's  law).  It  is  not  a  pattern  that  is  broadly 
applicable  to  intellectual  judgment  tasks.  This  pattern  is  also 
consistent  with  a  highly  causal  view  of  experience,  which  may  be  more 
applicable  to  psychophysics  than  to  probabilistic  prediction  tasks.  The 
deterministic  pattern  may  be  overlearned  from  extensive  psychophysical 
experience,  while  real  world  experiences  tend  not  to  allow  inferential 
strategies  for  probabilistic  judgments  to  be  efficiently  learned,  and  they 
later  are  thus  underlearned.  Peoples’  accurate  confidence  in  their 
psychophysical  strategies  seems  to  be  inappropriately  extended  to  their 
inferential  strategies.  In  summary,  peoples'  faith  in  what  they  have 
learned  from  experience  about  their  theories  may  be  misplaced,  and  people 
will  erroneously  conclude  that  because  a  theory  fits  some  data  the  theory 
is  correct. 

Not  all  analysts  view  intention  estimation  as  a  matter  of  judgment 
and  information  integration,  but  rather  as  a  form  of  historical  narration. 
The  last  section  of  this  chapter  summarizes  some  problems  with  narration 
logic. 

NARRATIVE  LOGIC 

The  only  thing  one  learns ’from  history  is  that  nobody  ever 
learns  anything  from  history. 

Hogal 
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The  chief  practical  use  of  history  is  to  deliver  us  from 
plausible  historical  analogies. 

James  Bryce 

In  an  earlier  chapter  we  used  Scheibe's  (1979)  distinction  between 
sagacity  and  acumen  to  separate  two  different  approaches  to  intention 
estimation.  Sagacity  refers  to  prediction  based  on  the  detection  and 
exploitation  of  patterns  and  prior  probabilities  in  past  experience. 
These  regularities  are  utilized  to  infer  the  likelihood  of  future 
behavior.  In  contrast  acumen  is  based  on  empathy  with  the  actor  whose 
behavior  one  is  attempting  to  predict.  Empathy  is  an  ability  to  take  the 
other's  role,  sensing  the  other's  perceptions  and  impressions,  and 
experiencing  the  other's  thought  process.  Whether  acumen  is  a  skill 
(i.e.,  something  that  can  be  taught),  intuition  (something  whose  source  is 
ineffable),  or  experience,  is  not  clear  (Minear,  1980,  offers  an 
interesting  perspective  on  these  issues,  see  also  Ornstein,  1977). 

Pipes,  an  historian,  (in  Godson,  1980;  180)  has  described  how 
acumen  applies  to  intelligence  prediction  and  estimation : 

...  fundamentally,  when  you  are  dealing  with  political 
analysis,  there  is  no  substitute  for  methods  which  have  come 
from  scholarship  ...  a  deep  knowledge  of  the  country,  of 
its  general  culture  and  its  political  culture  in  particular, 
from  what  the  Germans  call  Flngerspitzengef uhl ,  the  feeling 
"on  the  tips  of  your  fingers"  for  a  given  culture  where  you 
know  that  some  things  are  more  probable  and  others  less  so. 

Pipes  recommends  (p.  .175)  that  the  political  analyst  "be  given  very 
thorough  general  training  in  the  historical  method."  The  problems  of 
political  intelligence,  he  wrote  (p.  174)  "are  rational  only  to  a  certain 
predictable  point  and  are  often  emotional,  psychological,  cultural,  and 
therefore  of  a  kind  that  no  amount  of  science  can  ever  fix  or  predict." 

Sarbin,  a  psychologist,  agrees  (1980)  with  Pipes  that  the 
phenomenon  of  greatest  interest  to  intelligence  analysts,  future 
intentions,  are  inherently  unpredictable  from  a  scientific  viewpoint 
(i.e.,  sagacity)  because  they  are  fundamentally  unique,  but  may  be 
predictable  through  acumen.  Sarbin  sees  the  intelligence  analyst's  task 
as  unfolding  in  an  environment  of  contextualism  rather  than  science's 
environment  of ’ causality.  He  wrote  (p.  116) 

The  root  metaphor  of  contextualism  is  the  historic  event  in 
all  its  complexities  .  .  .  its  home  is  .  .  .  history  and 
literature. 

The  task  of  the  intelligence  analyst,  according  to  Sarbin  (p.  117),  is  to 
organize  a  chaotic  mixture  of  events  into  a  comprehensible  plot,  following 
a  story  line,  so  that,  like  a  literary  critic,  the  analyst  nn  "fathom  the 
intentions  of  the  author  (of  the  events],  to  'understand  '  co  decipher  the 
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meaning  of  the  creative  work  "  The  product  of  this  intelligence  process 
is  a  narrative  that  meets  tests  of  coherence.  Sarhin  does  not  reject 
prediction  based  on  sagacity,  he  just  argues  that  it  is  not  enough,  that 
the  prediction  of  an  adversary's  future  behavior  requires  acumen  because 
that  behavior  is  often  unique,  and  tied  to  no  past  patterns.  He  wrote  (p. 
137) 


To  predict  the  unique  case,  the  known  actions  of  a  target 
person  or  organisation  serves  as  the  framework  upon  which  a 
plot  is  constructed  .  .  .  acumen  follows  from  locating  the 
noticed  events  in  a  plot  .  .  . 

Historical  Perspectives 

Historians  begin  by  looking  backward.  They  often  end  by 
thinking  backward. 

Nietzsche 

Pipes  and  Sarbin  would  have  their  history  in  just  one  way,  a  flow 
of  unique  and  unpredictable  events,  and  it  is  true  that  some  historians 
treat  evidence  from  this  perspective.  Other  historians  do  not: 

The  rationalist  sees  evidence  as  exemplifying  deep 
uniformities;  the  intuitionist  sees  evidence  as  testimony  to 
uniqueness  (Kuzrainski,  1973). 

In  effect,  whether  an  historian  elects  to  be  an  intuitionist  rather  than  a 
rationalist  may  depend  on  the  degree  to  which  he  or  she  views  most 
important  processes  in  history  as  being  unpredictable  sudden  events  rather 
than  as  more  orderly  processes  which  are  occasionally  punctuated  by  sudden 
events . 

This  split  between  a  noncausal  view  of  existence  and  a  causal 
outlook  is  one  of  the  oldest  issues  in  philosophy,  and  need  concern  us  no 
further.  Because  some  historians  and  intelligence  analysts  adhere  to  the 
intuitionist  view,  and  practice  narration  rather  than  causal  prediction 
the  purpose  of  this  section  is  to  quickly  summarize  some  of  the  problems 
with  narrative  logic.  Not  being  an  historian  I  rely  heavily  on  the 
analysis  of  historians.  It  is  clear,  however,  that  taking  the 
intuitionist  position  on  prediction  does  nothing  to  eliminate  the 
possibility  of  cognitive  biases  weakening  the  process  of  estimation.  The 
analyst  who  attempts  to  predict  with  acumen,  rather  than  sagacity,  must 
still  make  sense  out  of  his  or  her  history.  In  doing  so  biases  and 
fallacies  are  likely  to  occur.  Many  are  the  same  as  those  affocting  the 
sagacious  analyst. 

Fallacies  of  history. 

Even  God  cannot  change  the  past. 

Agathon,  Nlcomachean  Ethics 
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It  has  been  said  that  although  God  cannot  alter  the  past, 
historians  can;  it  la  perhaps  because  they  can  be  useful  to 
Him  in  this  respect  that  He  tolerates  their  existence. 

Samuel  Butler,  Erewhon 

Fischer  (1970)  lists  and  describes  over  one  hundred  fallacies 
commitcd  by  historians.  Of  these  two  groups  are  especially  relevant  for 
Intelligence  estimation,  fallacies  of  inquiry  and  fallacies  of  explanation 
(see  Table  4.5;  for  a  list  of  Fischer's  fallacies,  see  Appendix).  Some  of 
Fischer's  fallacies  are  refinements  of  each  other  (e.g.,  39  and  75,  the 
numbers  refer  to  the  fallacies  listed  in  the  Appendix),  while  others  are 
directly  related  to  cognitive  biases  of  the  types  described  above.  For 
example,  the  fallacy  of  identity  (61)  is  closely  related  to  the 
representativeness  heuristic.  The  availability  heuristic  is  similar  to 
the  fallacy  of  prodigious  facts  (24).  In  general,  Fischer's  category  of 
inquiry  relates  to  the  categories  used  above  on  perceiving,  weighing,  and 
categorizing  data;  while  his  category  of  explanation  relates  to  assessing 
covariations,  assessing  causes  and  effects,  prediction,  and  theory. 
Several  of  Fischer's  fallacies  appear  in  naval  analysis. 

Inquiry . 

History  doesn't  repeat  itself  —  historians  merely  repeat 
each  other. 


First  rule  of  history. 

Fischer  suggests  that  facts  may  be  falsely  verified  by 
pseudo-proof  s ;  false’y  precise  and  specific  statements  of  no  real 
evidentiary  value  (fallacy  11).  This  is  occasionally  a  problem  for 
analysts  of  Soviet  naval  doctrine.  Any  given  statement  by  a  Soviet 
official  is  questionable  evidence  that  a  particular  doctrine  does  or  does 
not  exist  —  the  Soviets  are  rarely  so  specific  or  clear,  especially 
regarding  changes  in  doctrine.  Further,  a  given  statement  at  one  time  by 
a  Soviet  official  cannot  validly  be  used  as  evidence  on  Soviet  views  at 
any  earlier  time,  although  doctrinal  analysts  persist  in  making  just  this 
inference  (e.g.,  Hudson,  SND) .  The  need  for  Soviet  spokesmen  to 
demonstrate  the  prescience  of  Marxist-tenioism  obliges  them  to 
hindsight fully  revise  their  earlier  views  (occasionally  several  times), 
and  the  Soviets  are  never  shy  about  rewriting  history  to  suit  their  needs. 
As  we  have  noted  several  eimes  earlier.  Admiral  Gorshkov's  statements  in 
1967  on  what  the  Soviet  Union  was  planning  for  its  Kaoy  in  1954  are 
largely  specious,  although  they  are  sometimes  accepted  at  face  value  by 
analysts.  Similarly,  Soviet  naval  officers'  retrospective  claims  that 
they  opposed  the  party's  views  on  nonnuclear  wars;,  or  surface  ship 
construction,  or  balance  <cf.  Hudson,  SNOs  2b0)  should  not  be  taken  at 
face  value  as  reflecting  what  actually  transpired.  Since  the  Soviet 
authors  and  the  naval  analyses  are  resorting  to  the  same  source  tor 
guidance  in  these  matters,  i.e»,  hindsight,  it  is  not  surprising  that 
analysts  accept  the  Soviet  claims  that  this  is  how  things  were  back  then. 
Indeed,  given  outcomes,  things  might  have  been  as  the  Soviets  say,  but 
their  latter  day  statements  are  hardly  the  best  evidence. 
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Tabic  4.5,  Types  of  Historical  Fallacies* 


1.  Inquiry 

A.  Question  -  Framing 

B.  Factual  Verification 

C.  Factual  Significance 

IX.  Explanation 

A.  Generalization 

B.  Narration 

C.  Causality 
0.  Motivation 

E.  Composition 

F,  False  Analogy 


From  Fischer  ClV7l>).  For  a  list  of  fallacies, 
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Several  of  the  cognitive  and  conceptual  biases  of  analysts 
contribute  to  the  problems  Fischer  noted  regarding  factual  significance. 
Analysts  often  seem  to  select  “representative”  facts  in  the  form  of  case 
studies  to  demonstrate  their  point*  Having  abstract  information  about  the 
Soviet  Navy’s  behavior  in  the  representative  case,  the  analyst  implies 
certain  things  about  future  Soviet  behaviors.  To  make  these  inferences 
more  precise  the  analyst  may  use  several  cases  and  organize  them  into  a 
classification  or  categorization  scheme  (e.g.,  Dismukes  and  McConnell’s 
1979  “rules  of  the  game").  The  trick  in  this  is  knowing  which  cases  are 
most  representative  for  prediction  (i.e.»  representative  of  causes),  and 
not  to  select  cases  solely  because  they  are  representative  of  effects. 
The  latter  cases  are  useful  for  post  hoc  explanation,  but  may  offer  little 
information  for  predictive  purposes. 

On  the  other  hand,  the  analyst  may  be  an  intuitionist  rather  than 
a  rationalist,  and  select  cases  that  are  representative  of  the  essences 
(the  'inner  core  of  reality’)  of  Soviet  naval  behavior  (fallacy  23).  This 
narrative  approach  amounts  to  a  refinement  of  the  analyst's  theory  or 
schema  of  what  those  essences  actually  are.  As  we  noted  above,  people  are 
quite  adept  at  finding  evidence  or  altering  evidence  to  confirm  their 
theories,  and  largely  incapable  of  disproving  their  own  theories  without 
explicit  assistance. 

Some  naval  analysts  advocate  seeking  an  explanation  for  every 
Soviet  naval  behavior,  which  implies  that  every  Soviet  naval  action  has 
some  explanatory  or  predictive  significance  (fallacy  63),  an  unlikely 
situation.  A  related  tendency  is  to  strive  to  explain  or  predict  what  is 
strange  or  unusual  about  the  Soviet  Navy  (compared  to  Western  navies),  but 
to  leave  similarities  unexplained.  This  assumes  ; '  it  the  Soviet  Navy  does 
things  that  Western  navies  do  for  similar  reasons  (fallacies  71  and  79  and 
the  egocentric  attribution  bias)  and  that  unique  Soviet  naval  behavior  has 
some  special  significance  (fallacy  24), 

For  example,  naval  analysts  spend  much  effort  assessing  why  the 
Soviets  have  consistently  built  more  submarines  than  anyone  else*  Few  of 
these  assessments  make  much  (if  anything)  of  these  prosaic  facts  (1) 
submarines  are  small,  shallow  draft,  and  the  only  capital  ships  that  can 
be  built  at  inland  factories  and  moved  in  pieces  along  Soviet  rivers  and 
railroads,  (2)  they  have  very  small  crews,  (3)  they  were  often  used  as 
surface  vessels  (e.g*,  for  shore  bombardment)  in  World  War  U,  (4)  of  all 
chips  they  are  the  most  tactically  compatible  with  a  highly  centralised 
system  of  command  and  control.  The  facts  typically  assessed  as  important 
for  explaining  Soviet  submarines  have  to  do  with  naval  traditions* 
strategies,  economics,  technologies,  philosophies  and  doctrines,  and  naval 
effectiveness  (ef,  Moore,  Flanigan,  and  helsel,  |NI,  eh.  7), 

gxplanatlon.  Many  of  the  fallacies  of  generalisation  noted  by 
Fischer  a r e  "dire e 1 1 y  related  to  cognitive  biases.  For  example* 
insufficient  sampling  (32)  is  the  same  problem  as  the  “law  of  small 
numbers”  painted  out  by  Tversfey  and  Kahoeman  (1971):  a  belief  that  valid 
generalisations  can  be  made  from  extremely  small  sample* ,  or  even  from  a 
single  case  (fallacies  33:  generalisation  from  “the  lonely  fact,”  and  43: 
general fiat ion  fro®  “the  overwhelming  exception"), 

Several  naval  analysts  sees  to  be  willing  to  generalise  from  a 
'‘lonely  fact"  or  an  “overwhelming  exception.”  For  example,  Petersen  and 
Dutch  (in  Dismukes  and  McConnell,  1979:  144-IS2)  assess  Soviet  naval 
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involvement  in  tho  Angolan  crisis  as  reflecting  "the  state-of-the-art "  in 
Soviet  coercive  diplomacy.  They  view  (p.  148)  Soviet  deployments  as 
attempts  to  "signal  in  advance  (Moscow's]  opposition  to  any  U.S.  naval 
deployments  toward  tho  Angolan  Cheater: 

The  evidence  suggests  a  concerted  Soviet  effort  to 
discourage  (U.S.)  deployments,  actively,  via  the  surface 
combatants  deployed  ut  Gibraltar  and,  perhaps,  the  Jul iott 
(submarine],  and  passively,  by  curtailing  the  operat ions 
.  nearest  Angola  ...  To  the  extent  that  these  Soviet 
actions  were  taken  in  anticipation  of  possible  U.S.  moves, 
they  were  unprecedented  in  Soviet  naval  diplomacy  in  the 
Third  World  <p.  ISO). 

In  evaluating  the  evidence  for  this  lonely  tact  and  overwhelming 
exception,  Petersen  and  Durch  repeatedly  qualify  or  hedge  their  judgments 
“the  evidence  suggests  .  .  .,  the  possibility  .  ,  . ,  to  the  extent  that  . 
.  .  ’*  In  generalising,  however,  these  possibilities  become  facts  about 
Soviet  “state-of-the-art" t 


In  signaling  its  opposition  to  possible  U.S.  deployments, 
however,  the  USSR  maneuvered  its  navy  with  considerable 
restraint. 


In  his  analysis  of  this  incident,  McConnell  concludes  (in  hiamukes  and 
McConnell,  1979:  157-259)  that  the  U.S,  Wavy 

,  .  .  appears  co  have  been  the  target  for  a  Soviet 
attentional  show  of  force  ,  ,  .  (the  Soviets]  apparently 
made  a  naval  show  of  force,  either  to  demonstrate  an 
interest  in  protecting  USSH-Aogolan  lines  of  communication 
or  in  countering  U.S,  naval  threats  against  Cuban 
involvement  on  the  mainland,  Angola  was  the  boldest 
initiative  yet  taken  by  the  USSR  ,  ,  «  Surely  there  is  a 
trend  in  this  direction.  »  . 


In  their  conclusion,  hismykes  and  McConnell  U979;  2S9)  give  this  w;- * st>de 
the  status  of  a  full-fledged  fact: 

in  the  Angolan  crisis  in  early  I9?ii  (the  USSR]  went  even 
further  (than  merely  anticipating  what  the  U.S,  Mavy  would 
do],  deploying  surface  warfare  forces  into  the  central 
Atlantic  in  anticipation,  ef  a  U.S,  naval  counter-deployment 
that  no vev""ma ter i allied  ...  in  a  theater  where  one  can 
with  confidence  identify  (Soviet]  motives  as  predominately 
(it  not  exclusively)  politico-military  in  nature. 

It  is  worth  noting  that  the  Soviet  units  which  were  known  to  be  in  the 
South  Atlantic  to  counter  the  possible  deployment  of  a  U.S.  carrier  task 
group  were  a  newer  ASW  cruiser,  a  SAM  destroyer,  and  an  older  (J -cl as s' 
cruise  missile  mboarine  (cf*  Dismukes  and  McConnell,  1979:  144-157),  not 
the  typical  Soviet  anti-carrier  warfare  (ACW)  task  force  (the  Soviets 
typically  remove  their  newer  ASW  ships  when  an  ACU  task  force  is 
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assembled)*  The  only  meaningful  activity  noted  in  anticipation  of  a  U.S. 
deployment  was  the  sailing  of  the  ASW  cruiser  in  the  direction  of  the 
crisis  * 

Herzog  (NPSP :  41)  goes  evon  further  in  generalising  from  this 
incident  [note  how  Che  two  Soviet  surface  combatants  have  become  "its 
fleet") : 


The  Soviet  Union  finished  its  apprenticeship  in  the  use  of 
naval  power  to  advance  what  Admiral  Gorshkov  calls  "state 
interests"  when  the  presence  of  its  fleet  off  Angola  helped 
to  ensure  the  success  of  the  Soviet  backed  faction  .  . 

With  tha  success  of  the  Soviet-backed  forces,  and  the  lack 
of  naval  action  on  the  part  of  the  United  States,  a  complete 
reversal  of  roles  was  witnessed  ...  by  1976  the  United 
States  had  given  up  its  place  of  naval  dominance  and  had 
assumed  the  role  of  spectator  .  .  .  The  Soviet  Navy  .  .  . 

I  is]  able  to  briug  naval  power  to  bear  in  most  any  part  of 
the  globe. 

The  main  point  is  that  a  clearly  atypical  and  anomolous  episode  is 
generalized  into  a  trend  for  the  future  of  Soviet  and  U.S.  naval 
influence* 

An  instance  of  the  fallacy  of  generalizing  from  false 
extrapolations  (39)  was  reviewed  above  (see  'Prediction  -  Short-term 
Forecasts"  and  Figure  4.6).  The  problem  of  false  interpolations  (fallacy 
40)  seems  to  occur  when  naval  analysts  attempt  to  demonstrate  the  accuracy 
of  Admiral  Carshkov's  1967  speech  on  what  the  Soviets  planned  for  their 
navy  in  1954,  The  only  way  analysts  seem  able  to  get  from  one  end  point 
to  the  other  is  to  ignore  much  of  what  happened  in  between  (see  Chapter  3* 
Cases  i  and  5). 

Fischer's  (1970:  125)  description  of  the  "double-reversing 
generalization"  (fallacy  42)  could  he  applied  to  most  estimates  and  naval 
analysts  wilt  recognize  their  own  (or  at  least  each  other's)  hedging  as 
sometimes  approaching  Fischer's  extreme  li«it: 

»  ,  *  a  matte  of  mutual  qualifications  or  a  cunning  balance 
of  eatmiatie  contradictions,  or  a  trackless  wilderness  of 
pettifogging  detail,  or  a  slippery  ease  of  substantive  (as 
well  as  semantical)  shilly-shally. 

In  Chapter  t  we  described  the  general  problem  of  lack  of  specificity  in 
predictions  and  estimates, 

Similarly*  analysts  will  recognise  their  estimates  as  often 
succumbing  to,  the  temptation  to  sake  insidious  general tsatfoas  (fallacy 
4i>;  sneaking  in  generalisations  without  any  specific  number  a  via 
the  loose  use  of  teres  like  'few,  many,  sose,  normal,  often*'  A 
cnwfton  tost  It  is  to  deny  any  intention  to  sake  specific  predictions,  or  to 
estimate  intentions,  and  then  to  do  so  with  insidious  generalisations. 
For  esa »pie*  Chapter  IS  of  Securing  the  Seas  begins  Cp*  411); 

b’c  .  .  .  claim  no  special  vis  do*  that  allows  us  to  foretell 
the  future  intentions  of  the  Soviets  or  even  to  grasp  fully 
tin:  motives  implicit  in  sooe  of  their  current  activities. 
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It  then  relates  a  long  list  of  predictions  and  explanations  of  future 
Soviet  naval  behavior,  e.g.  (insidious  qualifiers  underlined); 

The  Soviets  seem  to  be  on  a  steady  course,  with  ample 
resources  allocated  to  maintain  at  least  a  tandem  775-ship 
navy  *  *  •  (p.  415), 

.  .  «  the  emergence  of  a  more  confident  and  expansive 
Kremlin  leadership,  -suggest (s)  that  Soviet  naval  elements 
could  now  be  used  in  more  offensive  roles  .  .  .  Soviet  naval 
forces  can  now  operate  in  some  tor ce  across  all  the  world *s 
oceans,  under  a  variety  of  strategies  to  threaten  the  West 
(p.  416-417). 

.  .  .  the  Soviets  tuny  elect  to  resist  U.S»  involvement  in 
some  '‘local  war“  »  «  .  (which!  cott Id  ultimately  produce  a 
confrontation  he tween  naval  elements  of  hast  and  West  .  .  . 

There  is  considerable  indication  that  the  Soviets  feel  they 
have  entered  a  new  era  to  which  they  are  less  constrained 
from  challenging  the  actions  of  the  West  (p,  4U>)* 

Of  the  fallacies  of  narration,  Soviet  analysts  are  perhaps 
especially  vulnerable  to  presentism  (fallacy  45)  since  the  tendency  to  tiae 
the  consequences  to  assess  the  antecedents  is  a  constant  factor  in  Soviet 
historiography.  Soviet  authors  must  keep  one  eye  firmly  on  the  present  as 
they  explain  the  past*  Soviet  analysts  are  likely  to  accept  mte  of  these 
hindsight ful  Soviet  views  than  is  justified  simply  because  so  much  Soviet 
material  is  based  on  this  approach. 

t%  is  virtually  inevitable  that  naval  analysts  practice 
tunnel  history  (fallacy  47);  i.e.,  explaining  and  narrating  naval  events 
iron  a  naval  perspective*  (fees l  analysts  seem  well  aware  of  the  danger 
that  tunnel  historians  may  beep  into  each  other  and  commence,  hurled  out 
of  the  light,  a  profitless  debate  waged  with  fallacious  “essences'* 
(fallacy  2j),  The  analysts  in  our  sample  continually  attempted  to 
overcome  this  problem  of  perspective  by  bringing  economic,  military, 
political,  technological,  even  organisational  perspectives  and  experts 
into  the  naval  analysis  study  groups*  ftava!  analysts  seemingly  realise 
they  cannot  altogether  escape  a  tunnel  perspective,  hardwire  mad 
Keihsnoeii  introduced  the  latest  volume  Cj£|;  xxxvi)  of  the  ’‘Soviet  naval 
studies  group'*  proceedings  with  a  call  He  more  synthesis  at  Soviet  naval 
policy  studies  with  research  §n  Soviet  f§rsi-gn,  military,  eeonomin,  and 
doses* is  policies*  Sfforts  at  synthesis  have  been  part  of  ail  three 
proceedings,  Math  (§§*£*  5*1)  termed  current  analysis  of  Soviet  naval 
power  &s  an  instrument  of  peacetime  policy  ‘"curiously 
underintelleetualised"’  compared  to  other  strategic  studies,  {the  contest 
makes  clear  that  booth  did  net  intend  this  ss  a  compliment-!  ftecSwire 
repeatedly  noted  the  treed  “to  extend  the  tangs  and  depth*  Of  analysis  of 
Soviet  naval  development  Igjjjjp*  n;  also  Shg*  lx;  5jU ;  ssxviJ. 

bike  the  fallacy  of  essences,  tunnel  history  is  related  to  the 
representativeness  heuristic*  samples  are  believed  to  represent  the 
characteristics  of  their  population,  the  essence  of  naval  history  is  naval 
events . 


A  few  naval  analyses  in  out  sample  seem  Co  commit  the  fallacy  of 
archetypes  (SI)  In  seeing  Che  Soviet  Navy  as  a  reinactment  of  the  Russian 
Navy,  and  Soviet  efforts  (e.g.,  the  drive  for  warm  water  ports)  as 
identical  in  character  and  motivations  to  Peter  the  Great's  efforts  (cf, 
Graham,  NPSP*  275-277,  287,  298). 

The  static  fallacy  (53)  conceives  of  a  dynamic  problem  as  a  static 
one,  as  in  the  unfolding  of  an  unchanging  plan,  or  the  emergence  of  some 
predetermined  entity.  As  related  to  behavior  the  static  fallacy  is 
closely  related  to  the  “fundamental  attribution  error*  (see  above):  the 
tendency  to  overestimate  the  dispositional,  motivational,  and  intentional 
bases  of  behaviors  and  to  underestimate  the  situational  and  environmental 
influences.  Naval  analysts  are  not  unaware  of  these  biases,  especially  in 
assessing  the  degree  to  which  Soviet  naval  events  reflect  a  plan*  For 
example,  Uismttkes  and  McConnell  (1979:  283)  write: 

In  the  case  of  capabilities  for  coercive  naval  diplomacy  .  . 

.  there  has  been  a  debate  over  how  much  may  have  been 
foreseen  and  provided  for  .  .  *  and  how  much  was  simply  ad 
hoc  reaction  to  circumstances.  We  suspect  much  more  was 
projected  than  is  usually  credited;  and  this  is  said  without 
any  of  the  sinister  connotations  ,  .  «  of  the  “mas ter  plan- 
or  the  “grand  design-  *  .  ,  the  Soviet  Union  (doesl  have 
development  strategies  for  long-term  goals  .  .  .  this  is  not 
to  say  that  the  Soviets  were  absolutely  committed  to 
anything  by  the  1954  decision  or  that  there  were  no  false 
starts,  or  shifts  In  accenting  the  general  framework,  or 
much  rethinking  at  critical  junctures  that  required  novel 
departures* 

In  other  words,  the  Soviets  have  ted  and  still  have  a  plan  for  coercive 
naval  diplomacy,  but  a  flexible  rather  than  static  one. 

Many  of  the  fallacies  of  historical  causality  have  parallel 
cognitive  causal  biases.  For  example,  the  tendency  to  believe  big  events 
have  big  causes  (fallacies  37,  bl>  are  similar  to  the  profound  motive 
fallacy  (Rothbarn  and  Fuleto,  *9?S»  see  ^Assessing  causes  ate  effects- 
above),  the  reductive  fallacy  (bO)  corresponds  to  the  tendency  toward 
minimal  causal  reasoning  ate  acceptance  of  the  first  cause  as  bast  cause 
(see  “minimal  causation-  above).  We  have  already  noted  the  problem  of 
“indiscriminate  pluralism"  (83),  or  proliferation  of  causes,  ate  the 
overfitting  of  explanations  to  data, 

Many  of  the  cognitive  problems  of  testing  theories  probably 
contribute  to  the  maintenance  of  fallacious  motivational  explanations. 
Once  a  motivation  hypothesis  is  accepted  it  will  be  very  difficult  to 
dislodge  in  view  of  the  confirmation  bias  ate  the  futeam&mia!  attribution 
error,  similarly*  the  use  of  analogies  (fallacies  §4»#|>  corresponds  to 
the  use  of  theories  ate  schemas  for  prediction,  ate  many  of  the  biases  of 
theory  and  data  characterisation  sees  to  tgteetlie  the  fallacious  use  at 
analogy  in  historical  oar ration* 


CHAPTER  5-  Ltme-USKO  METHODS  AND  EXPERIMENTAL  TECHNIQUES 

EUR  BETTER  ESTIMATES 


This?  chapter  attempts  to  relate  little-used  analytic  methods  and 
ci.,.jv  l  mental  techniques  to  the  estimative  problem  areas  described  in 
Chapter  4,  Some  of  these  techniques  are  used  now  by  naval  analysts  (but 
apparently  infrequently).  Others  have  been  applied  to  other  types  of 
intelligence  estimation.  Some  have  not  yet  been  used  by  intelligence 
analysts,  so  far  as  we  know.  All  of  these  methods  are  aimed  at 
compensating  for  or  preventing  the  information  processing  biases  that  can 
occur  in  unaided  analysis.  They  are  ail  analytic  aids,  not  substitutes 
for  analysts  or  analytic  reasoning. 

The  editor  of  a  recent  compendium  on  quantitative  approaches  to 
political  intelligence  in  the  CIA  observed  (Heuer,  1); 

The  behavioral  revolution  in  academic  political  science  has 
been  virtually  ignored  by  the  C CIA  1  and  the  intelligence 
community  as  a  whole. 

Although  Homer  saw  the  narrative  essay-  as  continuing  as  the  dominant  fora 
for  intelligence  estimates,  Hr.  recoaaended  greater  use  of  quantitative 
techniques  that  t 

.  .  ,  Help  to  trace  the  logical  consequences  of  subjective 
judgments ,  extend  the  mental  capacity  of  the  individual 
analyst,  force  the  analyst  to  make  Hi ft  assumptions  explicit*, 
or  help  organise  complexity  (p,  B). 

The  aids  described  below  are  desiq  '  enhance  analysis  o4  intentions  by 

moving  toward  the  goals  &suer  Its* 

m&mmm  data 

The  three  main  problems  noted  in  Chapter  4  retarding  the 
perception  a!  data  were  UJ  the  nonpeteeptisn  of  nonevents  and  negative 
evidence,  <2)  the  use  m  availability  Iniormatioa,  and  ())  the  use  of 
representative  features  of  samples  to  estimate  population 
characteristics* 

6y en t  s _and  N on# vents 

Naval  analysts  must  render  a  enntinueus.  ^differentiated  stream 
at  information  on  the  Soviet  Navy  Into  discrete,  discr l^lnable , 
desert bable  entities.  Perception  is  diserete  rather  than  e@nsi«u@us.  the 
Soviet  Navy,  its  major  units,  and  aeters  are  p @fg@£v§d  «#  performing  a 
series  of  discrete  aeiions.  These  aetione  divide  she  s&ssars  #i 
information  into  segments  or  u--*t§* 

Psychologists  hav-p  begun  to  investigate  h§w  peeple  segeent  this 
stteno  of  insnr&afinn  ins  *  series  of  discrete  action  events.  tins  stain 
finding  is  that  the  density  of  events  greater  the  «n»r«  unexpected 

the  agtion  (Newtson.  That  is,  when  people  $%ts'#ee  highly 

organised,  predictable,  step-hy^step  actions,  with  a  clear  hierarchy  of 
subordinate  and  superordinate  goals,  they  tend  to  segsewot  action  into 


grosser  units.  People  resort  to  shorter  units  of  action  when  perceiving 
unexpected  action.  Organization  of  the  perceived  action  becomes  extremely 
fine-grained  immediately  after  an  unpredicted,  significant  event  occurs. 

Most  intelligence  analysts  are  familiar  with  the  impact  of  crises 
or  "surprises"  on  normal  operations  —  requirements  on  intelligence 
production  increase  greatly.  Much  more  fine-grained  analysis  is  called 
for  then  normally. 

One  consequence  of  this  difference  in  event  perception  is  that 
different  coding  categories  are  applied  to  the  cases  of  expected  and 
unexpected  events.  Soviet  actions  during  a  crises  may  appear  different 
from  everyday  actions  because  the  former  are  subjected  to  fine-grained 
coding,  while  the  latter  fit  grosser,  more  familiar  schemas.  This 
suggests  that  analysts  make  strong  efforts  to  keep  their  fine-grained 
segmentations  comparable  (through  aggregation)  to  their  day-to-day  coding 
of  actions.  This  will  allow  for  meaningful  comparisons  of  crisis  and 
noncrisis  episodes.  Such  comparisons  may  be  precluded  if  the  analysts' 
fine-grain  categories  of  coding  events  in  crisis  are  not  comparable  with 
the  grosser  normal  coding. 

It  is  also  important  that  psychologists  have  found  that  as 
perceived  behavior  becomes  more  motivationally  important  to  the  perceiver, 
grosser  coding  units  tend  to  be  used.  That  is,  during  an  important 
crisis,  the  consumers  of  estimates  may  tend  to  use  grosser  codings  of 
events  at  the  same  time  that  analysts  are  using  more  fine-grained  codings. 
[This  assumes  that  decision-makers  and  operators  are  under  greater 
motivational  pressures  than  are  analysts.]  That  is,  arousal  leads  to  a 
tendency  to  focus  on  a  few  relevant  cues  and  decreases  the  range  of 
attention,  while  amplifying  its  intensity  (Kahneman,  1973). 

Several  studies  by  Newtson  (1973,  Frey  and  Newtson,  1973)  have 
shown  that  people  segmerting  action  into  larger  units  make  neutral 
attributions  as  to  causes:  i.e.,  the  actions  are  attributed  to  both 
situational  factors  and  dispositions  of  the  actor.  When  using  smaller 
units  of.  analysis,  people  tend  to  attribute  action  to  the  actors  alone, 
not  to  the  situation.  This  suggests  that  analysts  during  crisis  should  be 
alert  to  (1)  a  tendency  toward  "hypervigilance  or  the  close  monitoring 
of  a  few  indicators  (Janis  and  Mann,  1977)  by  analysts  or  estimate 
consumers,  (2)  the  possibility  that  estimate  consumers  may  be  looking  for 
very  gross  organizations  of  action  while  analysts  are  generating  extremely 
fine  analyses,  and  (3)  analytic  categories  for  crisis  action  may  be 
incompatible  with  the  categories  used  for  normal  actions,  possibly 
producing  a  false  analytic  dichotomy,  especially  regarding  the  causes  of 
action. 

A  method  which  might  help  analysts  to  code  a  stream  of  information 
into  useful  categories  was  demonstrated  by  O'Leary  and  Caplin  (197>:  182 
ff.)  for  State  Department  intelligence  analysts  using  data  on  conflict 
acts  between  ligypt  and  Israel.  Rules  for  coding  each  type  of  event  on  a 
scale  of  violence  were  used  to  score  tho  entire  event  series.  Analysts 
were  then  able  to  graphically  follow  events  in  terms  of  either  the 
frequency  of  events  of  different  levels  of  \  loience,  or  in  terms  of  the 
level  of  violence  itself.  Such  graphs  and  codings  enable  the  analyst  to 
capture,  respectively,  the  grosser  relationships  between  events  and  tint 
finer-grained  details  of  actions,  by  allowing  the  analyst  to  demonstrate 
patterns  and  trends  in  events,  coding  rules  and  methods  aid  in  the 
observation  of  nonevents  and  negative  evidence*  Interruptions,  omissions, 
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and  nonoccurrences  are  easier  to  detect  against  an  orderly  background  of 
action  trends. 

Data  on  Frequencies 

The  availability  heuristic  is  fundamentally  the  tendency  to 
substitute  memorability  for  an  estimate  of  frequency.  To  the  degree  that 
more  objective  data  on  frequency  are  readily  accessible,  the  analyst 
should  feel  less  compelled  to  use  availability  as  a  substitute.  Two 
techniques  for  systematic  frequency  recording  in  intelligence  analysis  are 
event  coding  and  content  analysis. 

Event  coding  has  become  a  staple  method  in  efforts  at  crisis 
forecasting  and  prediction  (see,  e.g.,  the  March  1977  issue  of 
International  Studies  Quarterly  on  "International  Crisis:  Progress  and 
Prospects  for  Applied  Forecasting  and  Management  "  or  Kaplan,  1981  for  a 
coding  of  the  political  use  of  Soviet  military  power).  In  general, 
elaborate  rules  for  coding  events  or  actions  are  specified  which  are  then 
applied  uniformly  to  the  stream  of  events.  This  allows  the  analyst  to 
make  quantitative  comparisons  on  any  of  the  dimensions  created  by  the 
coding. scheme.  Given  tne  widespread  use  of  event  analysis  in  early 
warning  intelligence  and  crisis  forecasting,  its  absence  in  naval  analysis 
is  striking.  While  several  naval  analysts  made  use  of  event  tabulations 
(see  Petersen,  in  Dismukes  and  McConnell,  1979:  ch.  2,  Tables  2.12-2.15, 
for  a  detailed  listing  of  Soviet  naval  operations),  the  events  were  noc 
elaborately  coded  and  frequency  analyses  were  uncommon.  Naval  analysts 
now  use  some  event  categories  (e-g  ,  frequencies  of  diplomatic  port 
visits)  in  their  studies,  so  they  do  not  seem  adverse  to  the  concept,  it 
may  be  that  more  complex  coding  of  Soviet  naval  events  waits  on  a  taxonomy 
of  naval  actions  to  provide  the  coding  framework.  McConnell's  analysis  of 
the  "rules  of  the  game"  (ch.  7  in  Dismukes  and  McConnell,  1979)  might 
provide  an  initial  step  foi  developing  such  an  event  coding  system,  and 
his  classification  of  cases  (Tables  7.1  and  7.2)  provides  a  rough  coding 
scheme  (see  Cohen,  1980,  for  an  assessment  of  "rules  of  the  game"  analysis 
in  estimation). 

Content  analysis  has  been  applied  to  intelligence  problems  since 
World  War  II  (e.g.,  George,  1959)  to  determine  objective  frequencies  for 
actions,  events,  or  statements.  Content  analysis  is  generally  applied  to 
verbal  or  written  statements  (e  g,,  propaganda*  speeches,  memoirs)  to 
determine  such  things  as  authenticity,  trends  in  semantics  or  rhetoric, 
shifts  in  interests. 

Friedheira  and  John  (SNP,  ch.  18)  wade  imaginative  use  of  content 
analytic  methods  to  determine  Soviet  positions  in  haw  of  the  Sea  (LOS) 
negotiations.  They  described  (p.  343)  their  technique  as  follows: 

Soviet  positions  on,  five  of  the  major  issues  that  the  USSR 
had  entered  into  the  UN  record  were  measured  by  thematic 
content  analysis  of  statements  by  official  speakers  who 
expressed  for  their  governments  a  preferred  position  ♦  .  . 

This  provides  a  systematic  record  of  all  major  points  made 
by  all  states  in  these  negotiations  since  they  began  in 
1967  . 


This  technique  allowed  Friedheita  aud  John  to  conclude,  for  example,  that 


the  Soviets  have  been  somewhat  flexible  on  the  issue  of  free  transits  of 
straits,  but  inflexible  on  fishing  rights.  They  were  also  able  to  "score" 
national  positions  on  LOS  issues  so  that  Soviet  views  can  be  compared  with 
U.S.  ,  Japanese,  or  other  national  positions.  They  also  compared  the  USSR 
positions  with  those  of  important  individuals,  e.g.,  Admiral  Gorshkov. 

Content  analysis  has  been  used  to  address  traditional 
Kremlinological  issues,  e.g.,  what  the  attitudes  of  Soviet  elites  were 
toward  Leonid  Brezhnev  (Heuer,  1978).  Heuer  analyzed  how  sixteen  Soviet 
elites  referred  to  Brezhnev.  He  found  an  index  of  personal  reference 
rank-ordered  the  sixteen  elites  in  terms  of  their  political  support  for 
Brezhnev  much  like  a  panel  of  three  CIA  experts. 

A  recent  study  by  Kirk  (1980)  of  all  public  speeches  by  members  of 
the  Soviet  Politburo  between  1972  and  1979  offers  some  interesting  content 
analysis  results.  She  found,  for  example,  that  the  'Soviet  Navy'  was 
mentioned  relatively  often  (338  times),  ranking  fourth  behind  'Soviet 
armed  forces'  (949),  'Soviet  Army*  (599),  and  'Soviet  defense  capability' 
(385).  The  fifth  and  sixth  issues,  'Soviet  troops'  and  'Soviet  security,' 
were  mentioned  much  less  frequently  (173  times  each).  Each  time  the 
speaker  mentioned  a  topic,  coders  assessed  the  speaker's  evaluative 
attitude  from  the  context  on  a  scale  of  good  (+3)  to  bad  (-3).  The 
Politburo  speakers  were  less  favorable  toward  the  Soviet  Navy  than  seven 
other  defense  topics  (Soviet  troops,  Soviet  Air  Force,  Soviet  Army, 
Strategic  Rocket  Forces,  Soviet  military  cadres,  PVO,  Soviet  armed  forces, 
in  that  order).  Each  reference  was  also  coded  for  "potency"  to  reflect 
whether  the  speaker  s  reference  to  the  topic  reflected  activity  (+3)  or 
impotency  (-3).  In  this  case  Politburo  references  to  the  Soviet  Navy 
again  put  that  service  behind  seven  other  defense  topics  (Strategic  Rocket 
Forces,  PVO,  DOSSAF,  potential  Soviet  defense  capability,  Soviet  military 
cadres,  Soviet  troops,  Soviet  Army),  and  equal  to  'Soviet  armed  forces' 
and  'Soviet  defense  capability*  in  "potency." 

It  is  unlikely  that,  given  the  effects  of  the  availability 
heuristic,  an  analyst  reading  this  number  of  Politburo  speeches  could 
accurately  recollect  the  relative  frequencies  of  such  references. 
Furthermore,  coding  such  dimensions  as  "evaluation"  or  "potency"  may 
provide  useful  information  on  elite  views  which  could  not  be  accurately 
ascertained  by  intuitive  judgment  alone. 

Features  of  Samples  and  Populations 

The  representativeness  heuristic  is  the  tendency  (1)  to  assume 
that  a  sample  is  entirely  representative  of  the  population  from  which  the 
sample  was  selected,  and  (2)  to  neglect  features  of  the  population  that 
are  not  in  the  sample.  The  methods  that  reduce  representativeness  are 
those  that  improve  the  chances  that  the  analyst's  appraisal  of  a  sample 
will  accurately  reflect  the  features  of  the  population. 

A  common  manifestation  of  the  representativeness  heuristic  is  the 
tendency  to  overemphasize  case-specific  information  and  underemphasize 
base-rate  data.  This  suggests  that  analysts  should  give  more  attention  to 
statistics  on  central  tendencies  (means,  medians,  and  modes)  and 
dispersion  (variance)  in  samples.  Naval  analysts  rarely  report  such 
information  and  seem  not  to  use  these  simple  descriptive  statistics.  Even 
the  moving  average  (a  smoothing  statistic),  commonplace  in  trend  analysis 
and  forecasting,  is  absent  in  our  sample  of  naval  analysis  estimates. 
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One  technique  used  by  naval  analysts  to  develop  the  features  of  a 
sample  is  expert  opinion.  A  panel  of  experts  is  requested  to  specify 
features  or  aspects  of  a  problem  that  are  important  for  analysis.  The 
analyst  then  collects  data  on  these  features  for  a  sample  and  uses  these 
lor  projection  to  a  population.  For  example,  Ivanoff  and  Murphy  (NPSP , 
ch.  7)  developed  nine  composite  technical  parameters  that  could  be  used  to 
assess  and  project  Soviet  technical  progress  m  anti-ship  cruise 
missiles. 

The  trends  in  these  composite  parameters  are  estimated  and  then 
Ivanoff  and  Murphy  wrote  (p.  153): 

...  conclusions  are  drawn  on  future  adversary  systems  that 
will  be  developed  .  .  .  This  .  .  .  requires  a  synthesizer 
rather  than  an  analyst  .  .  .  all  considerations  of  Soviet 
practices  are  merged  with  the  factual  evidence  of  the 
quantitative  analysis.  Future  systems  are  synthesized  and 
described  .  .  . 

Thorpe  (NPSP,  ch.  8)  used  a  panel  of  experts  to  determine  the  mission 
priorities  for  each  Soviet  ship,  aircraft,  and  submarine.  Since  many 
Soviet  naval  platforms  are  oeemed  multi-purpose,  Thorpe's  objective  was  to 
quantify  their  multiple  features. 

Dawes  (1974)  proposes  that  the  role  of  the  expert  in  predictive 
systems  should  be  to  determine  which  variables  seem  to  be  important  and 
how  they  should  relate  to  the  prediction : 

There  is  no  way  of  knowing  apart  from  [the  expert]  what 
variables  should  be  looked  at.  And  the  man  knows  what 
variables  to  look  at  only  because  he  knows  something  about 
how  they  predict  (p.  524). 

Once  these  features  are  selected,  Dawes  recommends  that  they  be 
systematically  tested  in  a  model  of  predictive  judgment  to  verify  the 
adequacy  of  the  expert-selected  variables  to  predict.  That  is,  in 
contrast  to  the  traditional  use  of  experts,  as  in  the  Ivanoff  and  Murphy 
study,  where  experts  selected  variables,  and  then  synthesized  from  them, 
Dawes  recommends  the  experts  select  the  variables  and  the  synthesis  and 
data  integration  be  done  mathematically  or  mechanically.  This 
recommendation  is  based  on  the  fact  that  humans  are  consistently  inferior 
to  mechanical  information  integration  systems  when  synthesizing  complex 
data  patterns. 

A  psychological  technique  that  has  had  very  little  application  in 
intelligence  could  aid  greatly  in  systematizing  expert  opinions  on  the 
features  of  events  or  any  other  samples  of  stimuli.  This  is  the 
technology  of  metric  and  nonmetric  multidimensional  scaling,  tree-fitting, 
and  clustering.  These  methods  will  be  discussed  more  fully  below,  under 
Characterizing  Data,  but  are  introduced  here  to  demonstrate  how  they  may 
ai<T  in  constructing  meaningful  perceptual  categories  for  analysts  from 
expert  or  analyst  generated  data. 

Shepard  (1980)  recently  summarized  research  on  these  methods, 
which  are  "computer  based  methods  for  constructing  representations  of  the 
psychological  structure  of  a  sot  of  stimuli  on  the  basis  of  pairwise 
measures  of  similarity  or  conf usability."  These  techniques  yield  three 
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complementary  representations  of  psychological  structures:  dimensional 
scales,  taxonometric  tree-structures,  and  clusterings. 

Generally,  this  technique  uses  judges  to  assess  the  similarity 
between  pairs  of  stimuli  or  to  sort  stimuli  into  categories. 
Alternatively,  stimuli  pairs  can  be  presented  to  people  lor  judgments  of 
"same"  or  "different."  The  similarity  ratings,  in  the  first  case,  or 
confusion  scores,  in  the  second,  can  then  be  mathematically  fitted  into  a 
dimensional  space  or  into  sets  which  preserve  the  psychological 
similarities  and  differences  between  the  stimuli  items.  Either  individual 
experts,  or  groups  of  experts,  can  have  their  judgments  thus  scaled  or 
clustered.  The  output  of  such  techniques  is  a  set  of  dimensions  or 
categories  on  which  stimuli  objects  can  be  measured  or  compared. 

In  other  words,  one  means  by  which  Thorpe  (NPSP,  ch.  8)  might  have 
approached  the  problem  of  mission  priorities  of  Soviet  Navy  platforms 
would  be  to  present  each  pair  (of  all  possible  pairings  of  platforms)  and 
ask  for  a  rating  of  the  similarity  of  missions.  These  expert  generated 
data  would  yield  a  set  of  dimensions  or  a  taxonometric  tree  structure  on 
which  platforms  with  missions  perceived  to  be  similar  would  be  closely 
located,  while  platforms  which  shared  no  missions  (in  the  experts' 
opinions)  would  be  found  far  apart.  These  dimensions  or  the  shape  of  the 
taxonomy  tree  would  be  the  fundamental  mission  aspects  of  these  platforms 
in  the  perceptions  of  these  experts.  However,  it  is  likely  that  the 
clustering  or  a  hierarchical  tree-figure  would  better  represent  the 
mission  variables  perceived  by  the  experts  than  a  set  of  dimensional 
scales. 

Why  should  one  use  scaling/clustering  procedures  to  abstract 
dimensions/structures  of  mission  priority  for  Soviet  Naval  platforms?  Why 
not  merely  ask  experts  about  these  missions,  as  Thorpe  did?  First, 
experts  do  not  all  perceive  stimuli  in  exactly  the  same  manner.  While 
Thorpe's  method  may  allow  an  estimate  to  be  made  of  the  differences 
between  experts  (e.g.,  range  of  opinion),  how  is  not  clear  since  the 
experts'  opinions  are  shifting  due  to  the  Delphi  technique.  In  contrast, 
scaling/clustoring  gives  a  precise  measure  of  unaccounted  variance  . 
Second,  experts  may  have  highly  complex  multidimensional  perceptions  which 
they  cannot  readily  dissect  without  aid.  Introspection  may  be  inadequate 
to  abstract  these  perceptual  categories  or  dimensions.  Similarly,  an 
analyst  could  use  such  techniques  on  himself  to  learn  what  categories  or 
dimensions  seemed  to  be  important  in  a  complex,  multidimensional  problem. 
Third,  it  is  feasible,  at  least  in  theory,  to  obtain  these 
scaling/clustering  results  unobtrusively,  at  a  distance,  e.g.,  from  the 
writings  of  Soviet  naval  officers  or  authorities. 

The  latter  application  of  scaling  requires  content  analysis  of  the 
co-occurrence  of  descriptors  with  objects.  For  example,  suppose  Soviet 
Admiral  X,  a  naval  expert,  always  describes  the  Kresta  I  and  Kresta  II 
cruisers  with  identical  modifiers.  Furthermore,  assume  some  of  these 
modifiers  are  used  to  describe  Karas ,  but  none  are  used  to  describe 
Krivnks.  A  measure  of  similarity  can  be  obtained  by  means  of  the  degree 
of  overlap  in  use  of  modifiers  for  these  and  other  ships.  These 
similarity  (..ensures,  in  turn,  can  be  u3ed  to  determine  the  degree  to  which 
(and  the  categories  or  dimensions  on  which)  Admiral  X  perceives  those  ship 
types  as  similar  or  different  (Rosenberg  and  Jones,  1972  ;  Rosenberg  and 
Sedlak,  1972).  Similarly  an  analyst  might  investigate  the  perceptual 
dimensions  of  Soviet  statements  on  missions  (e.g  ,  sea  denial,  anti-sea 
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lines  of  communication,  etc.),  doctrine  (e.g  ,  protection  of  state 
Interests),  events,  capabilities,  etc.  That  is,  merely  by  describing 
stimuli,  Soviet  spokesmen  are  revealing  considerable  information  on  the 
perceptual  categories  and  dimensions  they  apply  to  complex  objects  and 
events.  This  information  can  be  abstracted  rrom  their  statements  by 
analysts  and  evaluated  with  scaling  or  clustering  techniques. 

WEIGHTING  DATA 

The  fact  that  people  often  cannot  accurately  report  the  weights 
they  attach  to  data  in  making  estimates  suggests  that  explicit  "policy 
capturing"  assessments  of  analysts  may  assist  them  to  understand  and 
improve  their  estimation  processes.  That  is,  an  explicit  effort  can  be 
made  to  model  or  capture  the  quantitative  elements  of  the  estimation 
process  of  the  analyst  including  data  weighting. 


Figure  5.1  shows  schematically  how  this  can  be  done.  A  controlled 
set  of  data  stimuli  (S)  are  presented  to  the  analyst  and  the  analyst's 
estimative  response  is  observed  (R).  The  right  side  of  the  diagram 
suggests  the  analyst's  estimation  process.  The  input  stimuli  and  the 
output  response  for  this  process  must  be  quantified;  i.e.,  they  may  be 
qualitative  in  nature  originally  but  they  must  be  scaled,  coded,  or  rated 
by  the  analyst  to  yield  at  least  a  more-less,  plus-minus  quantitative 
estimate.  If  the  inputs  can  be  quantified  directly,  analyst  coding  of 
them  is  not  needed.  This  process  is  repeated  with  varied  stimuli  sets, 
i-e.,  the  analyst  sees  a  new  set  of  data  stimuli  and  makes  a  new 
estimate. 

The  analyst's  weighting  policy  is  captured  by  using  the  same  coded 
data  stimuli  sets  to  mathematically  predict  the  analyst's  estimative 
responses,  R,  shown  on  the  left  in  the  diagram.  That  is,  using  the  same 
inputs,  S,  we  solve  for  the  combination  rule  which  makes  the  optimal 
responses,  Y,  as  close  as  possible  to  the  analyst's  responses,  R.  The 
combination  rule  found  will  reflect  a  set  of  objective  weight  values  that 
indicate  the  weights  used  by  the  analyst  in  his  or  her  estimates.  The 
objective  weights  provide  indices  on  the  degree  to  which  the  analyst  used 
each  of  the  input  data  stimuli  dimensions  . 

Two  mathematical  policy  capturing  methods  are  commonly  used, 
linear  regression  and  Bayesian  analysis  (Slovic  and  Lichtenstein,  1971). 
In  general,  the  linear  regression  method  has  been  used  more  often  for 
assessing  data  weights,  but  the  Bayesian  assessment  of  the  diagnosticity" 
of  data  can  also  provide  information  on  the  degree  to  which  analysts 
weight  data  (see  Edwards,  1978). 

If  the  important  dimensions  are  known  on  which  analytic  judgments 
are  made  (e.g.,  from  a  multidimensional  scaling  of  analysts'  similarity 
judgments,  see  above)  analysts  might  simply  be  asked  to  rate  or  rank  the 
dimensions  in  importance.  These  weights  can  then  be  compared  to  the 
policy  captured  objective  weights  to  determine  the  self-insights  of  the 
analysts  into  their  judgmunt  and  information  integration  processes. 
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Figure  5.1.  General  Estimation  Diagram  Illustrating  Prediction  Analysis  (on 
the  left)  and  Process  Analysis  (on  the  right).  Stimuli  (S.)  are 
common  to  both.*  1 
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Bayesian  Techniques 

Bayesian  estimation  methods  have  been  used  extensively  in 
intelligence  analysis  (see  Slovic  and  Lichtenstein,  1971:  717-721,  and 
Slovic,  Fischhoff,  and  Lichtenstein,  1977:  25-28,  for  reviews  and 
references).  In  general,  these  methods  help  analysts  integrate 
probabilistic  data  into  their  judgments,  avoiding  the  tendency  to 
underweight  such  data  attd  not  adjust  posterior  probabilities  sufficiently. 
A  recent  application  of  Bayesian  methods  to  the  problem  of  estimating 
probabilities  of  a  Middle  Hast  conflict  was  described  by  Schweitzer  (in 
Hauer,  1978,  ch.  2).  As  Schweitzer  noted  (p.  19)  these  techniques  have 
been  applied  to  a  variety  of  intelligence  estimation  issues:  the 
likelihood  of  a  North  Vietnamese  offensive  in  1974,  the  probability  of  a 
Sino-Scviet  conflict,  the  chances  of  an  Arab-Israeli  war,  and  the  analysis 
of  order  of  battle  data  (p.  13). 

Bayesian  methods  have  also  been  recommended  as  a  means  by  which 
the  estimates  of  different  experts  can  be  effectively  corabinud.  Ponnessey 
(1977)  recommended  a  Bayesian  paradigm  for  the  systematic  cumulation  of 
evidence  from  related  studies.  He  suggests  this  would  overcome  three 
widespread  difficulties  which  make  research  data  difficult  to  interpret: 
(i)  the  circuitous  and  nonintuitivc  logic  of  traditional  statistics,  (2) 
lack  of  agreement  (often  latent  and  implicit)  among  analysts  on  the 
substantive  and  technical  premises  adopted  in  research  arguments,  and  (3) 
Che  low  diagnosticity  (weakness)  of  research  data  for  distinguishing  among 
alternative  hypotheses.  Morris  (1974,  1976)  recommended  bayesinn  methods 
for  integrating  the  judgments  of  experts  into  a  single  estimate  and 
outlined  a  possible  combination  mechanism  lor  this  (1976). 

Sample  Size  and  Base-Rotes 

Bayesian  methods  can  also  help  the  analyst  with  a  common  weighting 
problem,  the  tendency  to  overweight  ease  data  and  to  underweight  base-rate 
data.  By  successively  updating  prior  probabilities,  the  Bayesian 
techniques  ‘!huU*T  ha««~r&6e  data  into  the  estimation  process.  They  also 
tend  to  eeale  down  overweighted  esse  data  by  adjusting  its  impact  downward 
via  the  prior  probability  base  rate. 

Simpler  methods  can  help  analysts  give  more  weight  to  groups  of 
eases  than  to  the  most  recent,  vivid,  or  salient  ease.  When  ease  data  are 
coded,  use  of  a  moving  average  tends  to  ‘'smooth  eut“  extreme  data  points 
highly  salient  or  vivid  eases)  and  adjusts  recent  points  to  reflect 
the  recent  bass-rates  (!*§».  tins  span  of  the  moving  average).  Comparing 
ease  statistics  to  the  central  tendency  for  all  eases  (e*g,»  averages) 
allows  the  analyst  to  put  the  ease  into  perspective. 

The  use  of  averaging,  moving  averages ,  and  Bayesian  probability 
updating  also  redness  the  tendency  to  overweight  data  from  extremely  small 
Samples,  and  Helps  reinforce  the  law  of  large  numbers,  that  estimates 
based  on  large  samples  of  eases  are  more  representative  than  estimates 
based  on  small  samples*  The  two  main  objeetives  in  these  methods  are  to 
help  th@  analyst  to  avoid  under*  or  overreacting  to  a  single  piece  of 
information,  and  to  use  the  cumulative  information  contained  in  base-rate 
data. 
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Analysts  can  control  the  tendency  to  overweight  redundant  cues  by 


computing  the  correlations  between  them  and  reducing  the  weight  attached 
to  a  highly  redundant  (correlated)  variable.  Similarly,  the  analyst 
should  note  the  variabiiity  in  his  data  and  reduce  his  weighting  of  a  cue 
which  stops  varying  and  becomes  static. 

CHARACTERIZING  DATA 

In  Chapter  3  a  variety  of  memory  biases  were  discussed  which 
affect  the  characterization  of  data  and  its  organization  into  categories, 
factors,  classes,  and  generalizations.  Problems  were  .noted  that  result 
from  attempts  to  impose  either/or“  categories  on  events  or  objects  which 
share  similarities  as  well  as  differences.  The  tendencies  to  place  events 
and  objects  into  taxonomies  was  discussed  and  the  possible  biases  that  may 
result  were  described.  A  variety  of  analytic  methods  and  paradigms  can 
help  offset  these  difficulties-. 

Aiding  Memory 

In  Chapter  4  we  argued  that  the  remarkable  ability  of  naval 
analysts  to  recall  information  is  due  largely  to  their  complex  conceptual 
schemas  for  perceiving  relationships  between  aspects  of  the  Soviet  Navy. 
These  schemas  allow  analysts  to  efficiently  code,  store,  and  retrieve 
information.  In  general,  however,  the  schematic  rules  which  govern  these 
processes  are  tacit  and  implicit  in  the  analysts’  narrative  estimates. 
One  implication  of  this  is  that  analysts  may  disagree  because  their 
different  schemas  lead  to  different  perceptions  and  memories  of  the  same 
or  similar  data  sets.  Since  the  schematic  rules  for  processing  these  data 
sets  are  not  explicit,  such  sources  of  differences  caunot  be  explicitly 
determined. 

This  suggests  that  if  analysts  make  their  schematic  coding  and 
storage  of  information  more  explicit,  the  job  of  determining  the  sources 
of  differences  among  analysts  in  categorising  data  would  become  easier. 
Analysts  would  be  able  to  compare  categorisation  systems  and  contents 
explicitly,  as  well  as  comparing  their  conclusions. 

The  tremendous  growth  of  data  base  management  systems  and 
management  information  systems  in  business,  administratis >  and  government 
reflects  the  appreciation  or  the  need  for  extensive  and  flexible  means  for 
accurately  ceding,  storing,  retrieving,  and  organising  imermation.  While 
these  systems  tend  to  be  mast  often  applied  to  Quantitative  data,  they  can 
also  be  applied  to  coded  event  data  or  content  analysis  data.  Kirk’s 
(I9dd)  content  analytic  data  on  Soviet  political  elite  speeches,  tar 
example,  is  stored  in  a  data  base  management  system,  greatly  tact  1  Hating 
extensive  data  retrieval  or  manipulation  and  empirical  investigations. 

In  the  example  used  in  Chapter  4  to  demonstrate  that  a  naval 
analyst’s  conclusion  was  based  on  biased  sampling  (see  Chapter  4, 
''Characterising  Data* biased  Sampling-),  we  used  that  analyst’s  explicit 
coding  of  events  (diplomatic  port  visits),  tod  these  explicitly  coded 
data  not  been  available,  we  could  not  have  determined  that  the  analyst’s 
conclusion  was  bated  on  a  biased  sample. 

Naval  analysts  themselves  complain  of  being  unable  to  deduce  the 
implicit  coding  schemes  or  other  analysts.  For  example,  McConnell  (j>Nj 
612)  wrote: 
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MccGwire  and  tirickson  *  .  .  count  on  their  subjective 
impressions  of  "tone"  and  "thrust"  to  tell  them  that 
Gorshkov  is  an  advocate.  I  respect  the  conviction  behind 
this  approach,  and  perhaps  I  avoid  it  only  because  I'm  not 
good  at  it  ...  it  has  been  my  experience  that  others  have 
a  so-so  record  in  this,  too,  as  often  as  not. 

Making  subjective  impressions  into  explicit  coding  rules  is  often  a  fairly 
straightforward  (if  not  always  simple)  process  that  is  in  keeping  with  the 
scientific  requirement  that  subjective  impressions  be  replaced  by 
quantitative  measurements.  Such  coding  greatly  helps  analysts  determine 
the  validity  of  their  own  and  others  impressions,  as  well  as  facilitating 
accurate  recall. 

Hvsr*  coding  and  content  analysis  also  aid  the  analyst  in  efforts 
to  avoid  "selective  retrieval,"  by  facilitating  the  recall  of  the  actual 
original  data  rather  than  a  retrospective  reconstruction  of  it.  The 
tendency  to  "constructively  remember"  events,  a  process  affected  by 
hindsight  and  a  variety  of  memory  biases,  is  minimized  if  the  analyst  can 
quickly  ascertain  all  the  other  cases  that  fall  into  a  given  category,  or 
that  compare  favorably  on  salient  dimensions  to  a  case  in  point* 
Mechanical  coding  systems  provide  the  analyst  this  ability  to  organize  and 
manage  stored  information  and  help  minimize  the  analyst's  need  to  rely  on 
limited  and  fallible  memory. 

Another  reason  analysts  should  make  greater  efforts  to  code  their 
impressions  is  the  tendency,  noted  in  Chapter  4,  for  memory  to  distort 
psychophysical  impressious  of  extreme  cases,  Extremes  (biggest,  worst, 
smallest,  etc.)  are  well  remembered  as  being  extreme,  but  their  recalled 
dimensions  tend  to  be  less  extreme  than  the  original  dimensions. 
Psychologists  have  node  considerable  progress  in  developing  methods  for 
scaling,  scoring,  rating,  or  otherwise  measuring  psychological  sensations 
(o.g»,  see  Anderson,  1979),  Analysts  might  ssapl ->•  such  functional 
measurement  techniques  to  record  the  magnitudes  of  their  original 
impressions  so  chat  current  impressions  could  be  maintained  for  later, 
accurate  comparisons  with  future  impressions,  Anderson  (1379)  reported 
results  from  a  study  by  toon  that  arc  relevant  to  the  present  study. 
Adults'  and  childrens'  impressions  of  naughtiness"  were  recorded  for 
various  incidents  that  varied  in  terms  of  the  degree  of  severity  of  damage 
done,  and  in  the  intent  of  the  person  doing  the  damage.  Naughtiness  was 
found  for  both  adults  and  children  to  be  a  linear  function  of  both 
severity  and  of  intent,  but  children  weighted  latent  lens  and  damage  more 
in  determining  naughtiness  than  did  the  adults.  It  is  highly  likely  that 
many  naval  analysts  conceive  of  threats  as  being  a  function  of 
capabilities  and  intentions,  it  would  be  very  useful  to  try  these 
psychological  techniques  te  determine  how  analysts  emphasise  these  two 
components  of  threat  for  various  specific  issues  and  questions,  and  to  be 
able  to  record  their  impressions  over  time  in  some  form  of  comparable 
metric. 

Assessing,  Prototypes,  i-afegoi' ins  and  dimensions 

in  Chapter  4  we  argued  that  people  conceptualise  couples  events 
and  objects  in  “fuaay“  categories  with  loose,  overlapping  boundaries, 
rather  than  in  weither/or“  pigeonholes.  This  implies  that  category 
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membership  is  a  matter  of  "family  resemblance”  and  that  stimuli  are  coded 
in  terms  of  many  dimensions  relative  to  a  central  prototype.  Analysts 
would  be  best  served  if  their  impressions  could  be  coded  on  the  natural 
dimensions  they  themselves  use  to  perceive  events  or  objects,  and  if  their 
subjectively  meaningful  concepts  of  family  resemblance  and  prototypicality 
were  the  bases  for  the  coding  and  content  analyzing  of  data.  Rather  than 
imposing  arbitrary  coding  dimensions,  or  content  analysis  categories  on 
the  analyst,  recent  psychological  research  suggests  that  it  is  possible  to 
determine  explicitly  the  natural  categories  or  dimensions  the  analyst 
uses.  These  natural  categories,  or  dimensions  once  made  explicit,  could 
then  provide  the  analyst  the  ability  to  systematically  characterize  his  or 
her  impressions  without  grossly  distorting  the  analyst's  cognitive 
process.  This  psychological  research  also  suggests  that  these  natural 
categories  or  dimensions  are  rarely  completely  explicit  in  the  analyst's 
mind  before  such  assessment.  These  techniques  may  thus  help  make  the 
analyst's  methods  and  assumptions  more  accessible,  in  keeping  with  Heuer's 
(197B)  recommendations. 

Objects  or  other  stimuli  can  be  considered  to  have  a  set  of 
features  or  attributes.  A  person's  total  data  base  concerning  any  given 
object  is  rich  in  content  and  complex  in  organization  and  form.  It 
includes  features  of  appearance,  meanings,  functions,  relationships, 
history,  and  all  other  properties  that  are  known  or  can  be  deduced.  When 
faced  with  a  particular  analytic  task  (e,g.,  to  identify  the  object,  or 
determine  its  similarity  or  dissimilarity  from  other  objects)  people 
extract  and  compile  from  their  data  base  a  limited  list  of  relevant 
features  to  perform  the  task  (Tversky,  1977). 

There  are  two  approaches  that  can  be  taken  to  relate  objects  to 
one  another.  One  measures  the  distances  between  the  features  of  objects 
in  a  geometric  sense.  The  other  considers  the  overlap  of  common  features 
relative  to  uncommon  features  in  a  sot-theoretic  sense.  Which  of  these 
two  approaches  are  used  to  identify,  quantify,  and  organize  prototypes, 
categories,  or  dimensions  will  depend  on  the  objects,  the  task,  e-r  both 
(Sottath  and  Tversky,  197?j  Shepard,  19BQ),  Some  problems  facing  naval 
analysts  have  »  natural  dimensional  structure,  estimating  the 
severity  and  probability  of  threats,  Others  have  hierarchical  structure 
that  may  reflect  an  evolutionary  process  in  which  the  objects  all  have  an 
initial  common  structure  and  later  develop  additional  distinctive 
features.  An  example  of  tire  latter  might  the  eiassif session  of  Soviet 
tfavy  platforms, 

Soviet  naval  analysts  have  no  widely  accepted  method  for 
classifying  the  Soviet  general  purpose  navy  into  its  component  miss  tens. 
Thorpe  ChPSP ,  eh*  $)  attempted  to  develop  such  a  method  using  Delphi 
techniques,  «\  variety  of  problems  occur  when  Dei  phi  techniques  are  used 
(see*  s,g  ,  ilftfgeustetn,  Snort*  and  MeSss*  WIj  for  example*  the 
range  of  expert  opinion  e&ttverges  sharply,  although  there  4s  no  normative 
reason  why  sueh  convergenge  should  lead  to  greater  estimative  aerutaty* 
The  central  tendency  of  expert  judgments  often  shifts,  hut  in  »  manner 
that  has  no  discernible  relation  to  the  new  information  available  to 
exports.  That  is,  St  is  unclear  whether  selgbi  is  an  appropriate 
mechanism  fur  information  integration.  Delphi  is  also  costly  and 
f  i«te-CO«S  casing. 

Clustering  and  scaling  techniques  offer  a  far  more  promising 
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method  of  categorizing  judgments  by  experts  and  analysts  than  the 
questionable  and  costly  Delphi  method.  I’ or  example,  to  determine  how 
analysts  classify  Soviet  general  purpose  platforms  in  terms  of  wartime 
missions,  Thorpe's  objective,  one  could  follow  the  procedure  used  by  Kosch 
and  Mervis  (1973)  to  classify  vehicles  (sou  also  Tversky,  1977:  33d). 
Analysts  would  be  asked  to  list  all  the  possible  wartime  missions,  or 
alternatively,  one  could  give  all  analysts  a  list  of  missions,  as  Thorpe 
did.  I-’or  each  wartime  mission  and  each  platform,  analysts  would  be  asked 
to  list  those  features  of  the  platform  that  were  relevant  (positively  or 
negatively)  for  that  mission.  These  lists  provide  the  wartime 
mission-relevant  features  of  each  Soviet  platform  for  each  analyst  or 
expert.  A  master  catalog  (something  like  Jane's  Ships)  of  features  and 
attributes  for  each  platform  could  be  made  available  to  all  analysts, 
listing  weapons,  electronics,  beam,  draft,  propulsion,  etc.,  to  refresh 
the  analyst's  impressions  and  to  serve  as  a  codebook  tor  the  listings. 

It  is  then  possible,  using  the  lists  of  features,  to  determine  for 
each  pair  of  platforms  the  number  of  common  and  distinctive  features. 
From  these  data  it  is  possible  to  predict  with  high  accuracy  the  analysts' 
ratings  of  similarity  between  platforms  given  any  wartime  mission.  Using 
the  data  on  shared  and  nonsharod  features  and  (derived  or  obtained) 
ratings  of  similarity,  clustering  programs  can  be  used  to  determine  a 
hierarchical  clustering  diagram.  This  diagram  provides  a  detailed 
classification  of  each  platform's  pvreeived  capabilities,  relative  other 
platforms,  to  perform  each  wartime  mission.  The  .diagrams  created  by  these 
programs  reveal  the  main  cognitive  categories  used  by  the  analysts  to  make 
those  judgments.  That  is,  not  only  are  Soviet  Navy  platforms  categorized 
by  wartime  mission,  as  Thorpe  attempted,  but  *,  to  clustering  algorithms 
allow  us  to  determine  the  main  dimensions  the  analysts  used  to  make  these 
judgments.  The  latter  information  cannot  he  derived  from  Thorpe's  Delphi 
method.  The  net  result  from  the  clustering  approach  would  be  a 
classification  diagram  for  each  wartime  mission  showing  ho  t  each  Soviet 
platform  compares  with  ail  other  platforms  in  accomplishing  that  mission, 
how  the  analysts  grouped  platforms  of  similar  capabilities ,  and  how  (and 
why)  individual  piatfoms  and  groups  of  platforms  differ  from  each  other 
in  performing  that  mission. 

these  feature  analysis  techniques  also  allow  ua  t©  determine  for 
each  wartime  mission  the  ?rototypi«.  features  fur  that  mission,  a  measure 
«#  fat&iiy  teaeafelaaes  ^distance  itm  the  prototype)  fur  each  platform  can 
be  derived  stem  these  data  which  ailsws  seal  tag  «f  the  raftfeiftgs  »i 
individual,  multipurpose  naval  ships  and  aircraft  among  a  variety  ©f 
missions.  That  is,  a  ship  with  an  astfemely  close  resemblance  to  the 
prototype  for  a  particular  mission  would  be  sealed  to  have  a  high  ranking 
ret  that  mission. 

Thorpe *s  analysis  reunites  that  if  a  platform  has  a  high  weight 
Cpereent)  far  ©ae  ties  ten,  it  t  have  a  low  weight  for  other  missions 
ii.fe*.  percents  can  only  add  unto  This  forces  'eiihei/sf' 
distinctions  into  what  are  actually  'and/hoth*  Judgments »  example,  a 
wesdsfa  Soviet  ship  such  as  the  h  fast  a  f.jf  may  be  a  far  better  amiiship 
platform  that  the  obsolete  fe^ng,  hut  in  ffcerp**#  method,  the  farmer  gets 
til  percent  for  antiship  (because  at  its  heavy  weight  for  A$SfJ  while  the 
latter  gets  a  $0  percent.  tehile  Thorpe ‘s  meshed  may  be  meSeSSafy  Sdv  the 
eeanemle  analyses  he  performs,  it  is  probably  highly  misleading  os  a 
reflection  of  analysts*  eatsgar  fiat  ions  of  platforms  and  missions.  In 
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Thorpe's  method  a  Soviet  choice  of  an  obsolete  Krupny  over  a  Kresta  II 
would  be  scored  as  an  increased  Soviet  Navy  emphasis  on  the  antiship 
mission  simpiy  because  the  Krupny t  ineffective  as  it  may  be  at  antiship 
warfare,  is  even  less  capable  of  ASM.  This  seems  to  be  an  absurd 
conclusion  no  iiaval  analyst  would  make.  A  more  meaningful  measure  of 
mission  priority  would  be  to  measure  the  family  resemblances  of  each 
year's  new  Soviet  platforms  to  the  mission  prototypes.  This  would  allow 
mission  comparisons  without  imposing  the  unreasonable  trade-off  logic  of 
percentage  estimates. 

Intention  Categories 

The  classification  of  Soviet  naval  platforms  provides  a  ready 
application  of  modern  categorization  methods  to  Soviet  capabilities.  The 
many  overlapping  and  nonoverlappiug  features  of  ships  provide  an  easily 
quantified  basis  for  such  analysis. 

With  appropriate  adaptations  the  same  categorization  methods  might 
be  applied  to  issues  of  intentions  as  well.  For  example,  naval  analysts 
develop  models  of  Soviet  naval  behavior  in  various  situations  and  cases 
(e.g.,  McConnell,  in  Diamukcs  and  McConnell,  ch.  ?}.  It  should  be 
possible  to  assemble  lists  of  the  features  of  these  situations  and  cases. 
Analysis  of  these  features  could  then  determine  the  dimensions  on  which 
analysts  perceive  Soviet  intentions  as  varying.  The  dimensional 
structures  obtained  by  analysis  of  overlapping  and  nonoverlapping  features 
could  be  evaluated  by  assessing  the  analyst's  perceptions  of  similarity 
and  differences  between  eases.  These  latter  data  can  be  used  to  create  a 
dimensional  space  that  should  correspond  to  the  dimensions  obtained  from 
featwees  analysis. 

In  short,  wode-u  psychological  techniques  allow  a  quantitative 
assessment  of  semantical  and  perceptual  dimensions  or  categories.  The 
natural  categories  can  be  determined  and  then  used  as  the  basis  fee 
explicit  coding  and  quantitative  analyses,  because  the  dimensions  and 
categories  are  obtained  Urn  the  analyst's  own  cognitive  relations,  they 
tend  to  yield  intuitively  useful  classifications,  which,  however,  are  not 
intuitively  obvious  and  often  cannot  be  obtained  by  other  method*.  An 
important  consequence  is  that  the  quantitative  coding  based  on  these 
techniques  is  likely  to  be  high  in  qualitative  meaning  to  the  analyst. 

Factor  Analysis  In  Into! 1 I goose 

Several  recent  studies  have  attempted  to  quantify  the  factors 
analysts  use  in  analysts.  &ahigren  (ift  Hauer,  193?®,  ch,  S)  translated  a 
complex  theory  of  intranationai  political  violence  into  about  fifteen 
separate  social  and  societal  factors*  or  variables*  and  various 
relationships  among  then.  4  panel  of  intelligence  analysts  assigned 
nttacerical  values  t&  each  of  the  theory's  variables  end  the  median  scorings 
across  analysts  for  each  variable  were  used  f#  evaluate  the  theory.  |£»te 
that  ft^hlgteo  did  net  derive  the  variables  fssn  the  analysts*  cognitive 
relation*,  but  itm>  a  theory  of  political  violence. 

Pee  Intel JSgense  applies* sen  of  the  features  similarity  techniques 
described  above  was  feM  and  Filey's  Cio  Heuer,  19fi,  sb,  ?)  use  St 
ouitsdioensisaal  scaling  to  detemine  voting  bless  in  the  United  ffot !$«.§. 
While  useful  and  suggestive  weii -received  by  the  analysts,  the  results 
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of  this  invest Igai ion  arc*  <imbi}',uouu  largely  because*  the  wrong  tset ijuUology 
was  applied.  Voting  bloc  analysis  is  inherently  a  clustering  or  grouping 
problem,  rather  than  a  dimensional  problem.  ”  it. her  than  liiulcidimenslonai 
scaling,  Kent  mid  Wiley  should  have  applied  a  clustering  or  true-building 
technique,  and  attempted  to  develop  a  voting  bloc  taxonomy.  A  cluster  or 
tree  diagram  would  be  much  mote  representative  of  the  voting  subgroup  lags, 
which  Kent  and  Wiley  set  out  to  £i«H,  than  are  the  seating  diagrams  they 
derived  from  voting  similarity  data.  The  main  point,  however,  is  that 
intelligence  analysts  have  used  these  psychological  methods  oa  features 
similarity  data  with  some  success. 

Friudhuio  and  4elm  (SfiP,  ch,  lb)  used  content  analysis  of  United 
Nations  documents  on  the  haw  of  the  Sea  to  determine  Soviet  positions  mi 
various  issues  under  negotiation  in  the  l.aw  of  the  ilea  talks,  For  each 
issue  (e.g.,  rights  of  transits  through  straits)  the  frequency  of  various 
themes  mentioned  ie.g.,  tree  transits  with  exceptions;  and  limits)  provided 
a  score  for  that  theme,  By  scoring  themes  Friedheim  and  John  were  able  to 
compare  the  views  of  the  United  States,  the  USSR,  and  Admiral  Gorshkov  on 
several  taw  of  the  Sea  issues.  Frledheia  anil  J@hn  were  also  able  to 
predict  how  often  nat ions' would  favorably  mention  various  themes  by 
regressing  characteristics  of  the  countries  (e.g,,  geographical 
characteristics,  economic  interests,  ec-*.)  against  the  thematic  scores. 
This  technique  allows  the  afalysta  to  determine  factors  which  seem  to  make 
a  difference  in  bargaining  positions.  For  example,  the  important  factors 
for  the  Ud$&  position  on  various  issues  ware  (p,  i$4)t  membership  i»  the 
Fast  European  caucusing  group,  major  merchant  fleet.  Slue  dater  Navy, 
major  fishing  state,  distant  water  fishing,  straits  state,  broad  shelf, 
major  mineral  producer,  major  oil  producer,  and  offshore  oil  producer. 

Several  naval  analyse**  have  developed  methods  aimed  at  assessing 
the  intentions  of  Soviet  ship  designers.  These  methods  take  an  approach 
that  includes  explicit  decomposition  of  design  requirements  and  ship 
features  and  an  attempt  to  logically  relate  one  set  to  the  other,  While 
neither  ol  the  two  methods  described  below  used  the  psychometric  features 
analysis  methods  described  above,  both  suggest  that  systematic  use  of 
features  data  is  not  foreign  to  naval  analysts, 

Mehee  (Ml,  ch,  if)  presented  a  methodology  for  assessing  the 
factors  under  lying  warships  design  which  Is  quite  compatible  with  the 
psychometric  approach  outlined  above,  Ha  determines  the  ship  mission 
requirements  let  payload  and  performance  in  terms  of  various  factors? 
hull  sire*  sea^eeplisf,  propulsion  spends,  cruising  endurance  range, 
habitability,,  payload,  electronics,  and  these  are  the  types  of 
features  we  suggested  ahe*u  that  analysts  c-ruld  assess  and  list  for 
various  naval  platforms.  In  his  chapter,  Meh&a  compares  trends  in  these 
features  for  lavfet  and  §,§,  ship  types  over  time.  Me  bos  had  ssperts 
evaluate  tbs  trend  data  and  rank  she  major  design  characteristics  into 
priority  esder,  or  as  £eh@e  put  it  Cp»  5i§>? 

...  which  of  these  design  characteristics  appeared  t$  “get 

the  biggest  piece  «l  the  «ake“  in  the  ship  design  process? 

The  experts  determined  that  Soviet  ship  designee*  emphasise  factors  in  the 
same  prierity  as  did  the  United  itatea  in  building  her  id  war  IS  vintage 
ships . 

Anether  means  of  detetmluit^  priority  was  net  used  by  Sehae,  but 


has  been  used  in  other  fields  to  determine  critical  features  of 
technological  change.  This  is  to  regress  various  design  features  to 
predict  some  feature  of  technical  merit.  One  such  feature  is  initial 
operating  capability  date,  which  is  a  surrogate  for  modernity.  The 
question  then  becomes  which  design  factors  seem  to  be  driving  Soviet  ship 
developments?  A  similar  technique  was  used  by  Alexander  and  Nelson  (1972) 
to  assess  the  factors  influencing  Soviet  and  U.S.  aircraft  turbine  engine 
designs. 

Kehoe  evaluates  his  data  on  design  factor  trends  in  terms  of 
various  Soviet  missions  (e.g.,  sea  denial).  It  would  be  interesting  to 
use  the  features  analysis  methods  outlined  above  to  determine  natural 
taxonomies  or  dimensions  of  Soviet  ships,  and  to  see  if  similar  mission 
categories  or  dimensions  emerged  < 

Meier  (SNI ,  ch.  20)  describes  a  different  method  aimed  at  the  same 
objective  as  Kehoe' s,  determining  the  relative  priorities  given  by  the 
Soviets  to  firepower,  sustained  combat,  command  and  control,  speed, 
endurance,  seakeeping,  protection,  and  personnel  support.  Meier's  method 
is  a  reverse  engineering  process  which  uses  an  iterative  computer  program 
that  attempts  to  determine  feasible  design  requirements,  standards,  and 
practices  from  the  features  of  the  finished  ships  . 

ASSESSING  COVARIATIONS 

In  Chapter  4  we  noted  the  tendency  of  people  to  overestimate  the 
strength  of  theory-driven  covariations  and  to  neglect  or  underestimate  the 
strength  of  data-driven  covariations.  We  also  found  this  tendency  seemed 
to  extend  to  naval  analysts.  Obviously,  the  most  direct  remedy  for  these 
problems  is  to  increase  the  use  of  quantitative  measures  of 
co-occurrences.  Such  measures  should  be  habitually  applied  to  any  data 
that  could  conceivably  be  related.  This  will  tend  to  reduce  beliefs  in 
spurious  theory-driven  correlations,  because  accumulating  evidence  will 
fail  to  support  the  theory,  and  to  draw  attention  to  unsuspected 
relationships.  Only  some  of  the  observed  correlations  in  data  sets  will 
be  meaningful:  some  will  be  spurious  statistical  noise,  and  some  will  be 
statistically  reliable  but  uninterpretable.  None  of  these  are  major 
problems.  Perhaps  the  main  problems  are  to  encourage  analysts  to  give 
data-driven  patterns  of  co-occurrence  serious  consideration,  and  to 
reconsider  theories  which  are  unsupported  by  data  patterns. 

Actuarial  Models  and  Backcasting 


Referring  to  Figure  5.1,  we  can  note  the  optimal  response,  Y, 
given  on  the  left  side  of  the  diagram.  This  is  the  best  prediction 
possible  given  the  objective  values,  X,  of  the  stimulus  inputs,  S.  For 
example,  a  naval  analyst  may  be  able  to  measure  (X)  several  features  (S) 
of  the  Soviets'  building  program  for  a  particular  ship  class.  The  analyst 
may  regress  these  against  actual  production  figures  in  the  past  (criterion 
values)  to  determine  the  optimal  combination  rule.  This  rule  can  then  be 
used  to  predict  future  output,  Y.  This  process  is  labeled  actuarial  and 
as  was  outlined  in  Chapter  4,  the  actuarial  prediction  process  is 
consistently  superior  to  the  process  shown  on  the  right  jn  Figure  5.1,  the 
clinical  process.  That  is,  when  estimators  attempt  to  intuitively 
integrate  information  on  the  inputs,  S,  using  a  psychological  combination 
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rule,  they  are  less  accurate  predictors  than  an  actuarial  model  of  the 
same  judgments. 

This  suggests  that  analysts  make  greater  use  of  actuarial  models 
in  formulating  and  revising  their  theories  about  covariations.  We  will 
have  more  to  say  about  these  techniques  below  under  "Improving 
Predictions."  One  of  the  advantages  of  actuarial  methods  is  that  they 
force  the  analyst  to  assess  the  relationships  between  criterion  values  and 
input  data.  Actuarial  methods  force  the  analyst  to  consider  the  strength 
of  theory-driven  covariation  hypotheses  in  light  of  past  data.  If  the 
theory-driven  relationship  is  absent  in  the  past,  the  analyst  must 
reconsider  using  the  theory  as  a  basis  for  future  predictions.  This  use 
of  actuarial  techniques  and  past  data  to  check  suspected  theoretical 
relationships  is  a  form  of  “backcasting, ”  i.e.,  an  attempt  to  correctly 
estimate  when  true  values  are  already  known.  If  a  theory  cannot 
so- cess fully-  fit  past  events,  its  validity  for  the  future  is  questionable* 
If  the  theory  consistently  over-  or  underpredicts  past  criterion  values, 
the  analyst  can  make  corrections  to  “dubias"  the  error,  and  thus  improve 
the  theory's  accuracy. 

The  actuarial  formula  provides  the  optimal  predictions  given  the 
input  data,  but  it  may  not  be  as  useful  or  interpretable  as  the  analyst's 
theory.  In  other  words,  the  analyst  may  wish  to  retain  and  improve  his  or 
her  theory  (which  is  heuristic  and  interpretable ) ,  while  using  the 
actuarial  formula  for  making  predictions.  As  the  theory  comes  to  resemble 
the  actuary*  formula,  the  former  becomes  more  accurate  as  a  predictor, 
and  the  lat^r  becomes  more  interpretable. 

In  effect,  research  on  clinical  and  actuarial  judgment  suggests 
that  estimators  should  attempt  10  assess  covariations  between  input  data 
and  criterion  values  if  an  actuarial  method  is  possible.  When  actuarial 
methods  are  possible  they  provide  the  optimum  description  of  the 
covariations  between  input  data  and  criteria,  and  greatly  simplify 
assessment  of  covariation. 

It  is  important  to  note  that  the  expert  judge  must  specify  what 
the  input  variables  are  to  be.  Aetvsarial  modeling  itself  cannot  dec ermine 
what  input  stimuli  should  be  considered  as  predictive  of  the  criterion 
values,  both  the  analyst's  theory-driven  hunches  and  empirical 
data-driven  search  for  possible  correlations  can  provide  clues  for  the 
inputs  to  the  actuarial  methods.  Only  the  naval  analysts  can  know  what 
variables  are  likely  to  be  worth  checking  as  possible  predictors  of  future 
Soviet  behaviors*  The  actuarial  method  is  the  optimal  means  of  assessing 
these  hunches. 


Bootstrapping 


When  criterion  values  are  known  or  knowable,  as  in  Soviet  ship 
inventories,  it  is  possible  to  fit  regressions  of  input  data  on  the 
criterion  values  to  build  actuarial  prediction  models.  Analysts,  however, 
are  often  called  upon  to  estimate  values  tor  which  chore  are  no  clear 
criterion  values,  e.g.,  the  level  of  Soviet  threat.  In  these  cases 
analysts  judgments  I ly  provide  the  measure  of  the  criterion  values, 
deciding,  «.g.,  whether  Cluj  throat  is  high  or  low.  fio  objective 
criterion  values  exist  for  sueh  eases  against  which  to  compare 
predictions,  i.e.,  the  Y  or  8  in  Figure  5.1  do  not  correspond  to  any 
unambiguous  measures. 


This  lack  of  criterion  values  uoes  not  eliminate  the  possibility, 
or  the  need,  for  systematic  methods  of  assessing  covariations. 
Psychologists  have  determined  that  linear  models  which  fit  regression 
equations  to  past  clinical  judgments  (i.e.,  the  R's  in  Figure  5.1),  can  be 
used  to  replace  the  clinical  judgment  process.  Such  models  outperform 
clinical  judges  because  they  eliminate  human  unreliability.  Reliability 
places  an  upper  limit  on  validity,  if  reliability  increases,  greater 
accuracy  is  possible. 

This  technique  of  modeling  the  judge's  judgments  and  then  using 
the  judgments  of  the  model  has  been  labeled  “bootstrapping,"  i.e.,  pulling 
the  judge  up  by  his  bootstraps  (Dawes,  1971;  Goldberg,  1970  ). 
Bootstrapping  will  improve  judgments  slightly  under  almost  any  realistic 
task  conditions  and  it  can  be  applied  blindly,  in  cases  where  criterion 
information  is  absent  or  vague,  with  the  expectation  that  the  predictions 
made  will  be  improved  (Camerer,  1980).  Furthermore,  as  long  as  the 
regression  model  of  the  judge  determines  the  input  variables  for  the 
prediction,  determining  the  exact  weights  used  by  the  judge  is  not 
necessary;  equal  weights  are  about  as  good  (Dawes  and  Corrigan,  1974).  In 
other  words,  the  weighting  parameters  of  the  bootstrapping  model  need  not 
be  very  specific  once  the  right  variables  are  identified.  The  key  again 
is  knowing  which  variables  to  try  and  the  only  realistic  source  for  these 
is  the  expert.  Once  the  naval  analyst  identifies  the  variables  that  seem 
important  for  making  an  estimative  judgment,  the  bootstrapping  method  can 
best  determine  the  actual  covariation  between  those  variables  and  the 
expert's  judgments.  These  variables  can  then  be  combined  linearly  with 
equal  weights  to  estimate  the  expert's  future  judgments  more  reliably  (and 
thus  more  accurately)  than  could  the  expert. 

There  are  obviously  implications  for  prediction  in  these  actuarial 
and  bootstrapping  models,  but  the  point  for  this  section  is  that  they 
provide  systematic,  data-driven  means  to  appraise  suspected  covariations 
that  eliminate  the  problems  of  theory-driven  covariation  appraisal. 

Environmental  Effects 

Since  expert  analysts  must  play  a  central  role  in  selecting  the 
variables  for  use  in  actuarial  or  bootstrapping  models,  it  is  important  to 
reiterate  a  point  made  throughout  Chapter  4,  that  people  are  often 
insensitive  to  environmental  effects  such  as  regression  or  base  rates. 
That  is,  analysts  are  unlikely  to  adequately  attend  base  rate  variables, 
and  are  likely  to  overatcend  case-specific  variables  (Einhorn  and  Hogarth, 
1978).  In  particular,  to  improve  covariation  assessments,  ic  is  necessary 
to  include  data  on  diseonf ivming  events  as  well  as  on  positive  hits.  That 
is,  analysts  should  bo  especially  careful  to  collect  and  record  data  on 
(at  least)  all  four  cells  ot  the  four-fold  present-absent 
cross-tabulations  that  oet  mine  the  relation  between  an  indicator 
variable  and  a  predicted  variau.se. 

One  means  used  frequently  by  naval  analysts  to  display  base-rate 
data  is  the  time  trend  line,  i.e.,  a  graph  of  data  over  time.  For 
example,  Kehoo  (SHI,  ch.  18)  displayed  data  on  various  capabilities  of 
Soviet  and  U.S.  ship  types  over  time  Co  demonstrate  changing  trends  in 
various  features*  On  the  other  hand,  merely  displaying  a  base-rate  does 
not  mean  the  analyst  will  use  the  base-rate  in  estimates  (e.g*,  see 
ivanoff  and  Murphy,  KPSFs  149,  Figure  32). 

O'Leary  and  Coplin  (1975,  ch.  4)  presented  a  detailed  case  study 
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of  how  careful  cross-tabulations  of  data  assisted  State  Department 
analysts  to  make  judgments  about  covariation  between  military  expenditures 
and  other  variables  in  Latin  America.  Although  the  State  Department 
analysts  made  extensive  U3e  of  quantitative  data,  they  did  not  explicitly 
assess  bivariate  correlations  to  evaluate  their  theories  or  forecasts. 
O'Leary  and  Coplin  showed  that  several  postulated  relationships  between 
military  arms  acquisitions  and  other  less  quantitative  factors  (e.g., 
economic  conditions,  role  of  the  military  in  government,  need  for  internal 
defense)  could  be  d'.rectly  assessed  with  cross-tabulations  or  correlation 
analysis.  These  techniques  were  applied  to  cross-sectional  data  (i.e.}  a 
group  of  Latin  American  countries)  as  well  as  to  data  on  individual 
nations.  The  covariation  assessments  were  able  to  confirm  several  of  the 
State  Department  analysts'  theories,  as  well  as  showing  that  some 
theoretical  relations  did  not  exist  in  historical  data.  O'Leary  and 
Coplin  described  (p.  148)  th:s  covariation  "backcasting"  exercise  as  i 

.  .  .  one  viable  way  of  incorporating  clearly  defined 
variables,  quantitative  techniques  of  analysis,  and  the 
important  discriminating  character  of  the  Latin  American 
nation,  all  of  which  appear  to  be  essential  to  making 
accurate  explanations  and  predictions  about  changes  in  Latin 
American  military  spending. 

The  main  implication  of  the  O'Leary  and  Coplin  study  is  that  quantitative 
covariation  assessment  methods  can  be  applied  even  when  the  factors 
involved  are  largely  qualitative. 

CAUSE  AND  EFFECT  ASSESSMENT 

The  problems  analysts  may  encounter  in  generating  cause  and  effect 
explanations  of  intentions  were  reviewed  in  Chapter  4.  These  problems 
generally  fall  into  two  groups;  search  and  hypothesis  generation.  [This 
division  corresponds  to  the  two  basic  psychological  models  of 
problem-solving  and  thinking  strategies;  heuristic  search  and  hypothesis 
generation  and  test,  see  Gecwin  and  Newsted,  1977.)  Search  problems 
interfere  with  the  analyst's  inductive  search  for  causal  patterns  in  data 
sets,  or  bias  the  search,  so  that  certain  erroneous  or  misleading  patterns 
are  easily  found  and  labeled  as  causal.  Hypothesis  generation  problems 
interfere  with  the  analyst's  deductive  reasoning  from  data  patterns  and 
lead  the  analyst  to  generate  false  hypothetical  explanations  from 
available  data  sets.  These  false  hypotheses  may  then  mislead  the 
analyst's  subsequent  perceptions  and  analyses. 

Chapter  4  also  noted  that  naval  analysts  themselves  seem  to  be 
aware  of  tho  methodological  difficulties  of  establishing  cause  and  effect 
relationships  (see,  e.g.,  booth,  SNIt  470),  but  few  of  the  sampled  uuval 
analysts  made  any  use  of  sophisticated  methodologies  for  causal  analysis. 
Some  of  these  causal  methodologies  have  been  applied  to  problems  of  naval 
intelligence  and  others  to  nonnavai  intelligence  estimation  problems. 

Causal  Search 


The  sources  of  biases  of  causal  search  can  be  divided  into  (1) 
incomplete  perceptions,  (2)  mistaken  perceptions,  and  (3)  overly 
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simplistic  perceptions.  These  problem  areas  overlap  (incomplete 
perceptions  contribute  to  overly  simplistic  perceptions)  and  are  more  than 
what  is  typically  meant  by  "perception."  We  use  the  term  "perception" 
here  <;o  emphasize  an  inductive  search  of  data  features  for  causal  patterns 
which  then  modify  hypotheses. 

Incomplete  perceptions.  Incomplete  perceptions  of  causal  patterns 
are  probably  largely  due  to  faulty  covariation  assessment.  That  is,  an 
analyst  may  be  over-attentive  to  positive  instances  of  covariation  of  one 
event  and  another  (++  events).  This  over-attention  to  positive  cases  can 
suggest  a  causal  relation  if  the  analyst  neglects  to  search  out  evidence 
of  +-  or  -+  events  as  well.  That  is,  the  suspected  cause  may  be  present 
when  no  effect  occurs,  or  absent  when  the  effect  occurs.  The  analyst 
should  also  confirm  the  negative  case,  that  the  effect  is  absent  when  the 
cause  is  absent  ( —  events).  There  is  a  tendency,  however,  to  not  search 
beyond  the  ++  events  for  evidence  of  covariation.  In  the  section 
preceding  this  one  we  outlined  a  variety  of  cross-tabulation  and 
covariation  assessment  methods  which  help  the  analyst  evaluate  a  suspected 
pattern  of  covariance. 

Mistaken  perceptions.  Mistaken  perceptions  are  those  patterns 
which  tend  to  be  perceived  as  causal  because  of  intuitive  cognitive  logic 
or  perceptual  biases  regarding  causal  relationships.  For  example,  things 
we  focus  our  attention  on  tend  to  be  perceived  as  causal.  Outcomes  which 
match  the  intentions  of  an  actor  are  naturally  assumed  to  have  been  caused 
by  the  actor.  Events  which  share  temporal  or  physical  characteristics  may 
be  perceived  as  causally  related.  These  intuitive  logical  relations  and 
biases  may  lead  the  analyst  to  search  for  data  to  confirm  these  patterns, 
producing  a  belief  in  a  false  causal  relationship,  bolstered  by 
selectively  perceived  data.  These  perceptions  and  the  beliefs  that  result 
often  seem  intuitively  obvious  and  amply  confirmed  by  the  data  which  are 
selected  to  "prove"  them.  It  is  quite  difficult,  if  not  impossible,  to 
avoid  such  perceptions  and  beliefs  altogether  since  they  are  based  on 
highly  efficient  and  logical  concepts  about  causality.  That  is,  for  many 
or  most  causal  relationships  these  percept  ions  and  concepts  are  not 
mistaken  at  all.  Rather  than  attempting  to  avoid  such  perceptions  or 
concepts,  it  is  easier  to  attempt  to  establish  their  validity  as 
systematically  as  possible. 

The  sampled  naval  analysts  typically  evaluated  causal 
relationships  narratively.  That  is,  evidence  in  favor  of  a  suspected 
causal  relationship  was  listed  and  evaluated  narratively  to  establish  a 
coherent  relation  between  the  suspected  cause  and  the  effect.  Evidence 
for  or  against  (typically  against)  other  possible  causes  would  be  listed 
and  evaluated.  Rarely  was  there  any  description  of  an  effort  mounted  to 
make  these  evaluations  systematically  comparable,  i.e.,  to  give  the 
favored  and  disfavored  possible  causes  an  equivalent  assessment.  That  is, 
analysts  typical lv  reported  what,  amounted  to  results!  the  supported 
hypothesized  ca^se  (and  the  supporting  evidence), ~and  the  rejected 
hypothesized  causes  (and  the  discontinuing  evidence).  The  strengths  or 
equivalence  of  the  assessment  methods  often  could  not  he  judged. 

Causal  analysis.  Several  social  scientists  have  outlined 
methodologies  for  making  systematic  assessments  of  causal  relationships  in 
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nonexperimental  research  (e.g.,  Asher,  1976;  Blalock,  1 964 ;  Heise,  1975). 
These  methods  are  labeled  "causal  modeling,"  or  "causal  analysis,"  and  are 
techniques  for  selecting  variables  that  are  potential  determinants  of 
effects,  and  attempting  to  isolate  the  separate  contributions  to  effects 
made  by  each  suspected  cause.  Because  all  the  candidate  causes  are 
evaluated  within  the  same  model,  the  assessment  tends  to  be  more 
systematic,  equivalent,  and  transparent.  As  we  noted  in  Chapter  4, 
"causes”  can  never  be  proved  because  they  are  mental  rather  than  physical 
constructs.  Causal  models  are  merely  analytic  aids  for  evaluating  and 
assessing  hypothesized  causal  relationships. 

Causal  models  typically  use  mathematical  regression  equations  as 
causal  equations.  That  is,  a  variety  of  suspected  causes  are  combined  in 
a  linear  equation  in  an  attempt  to  determine  the  impact  of  each  suspected 
cause  on  the  effect.  Causes  with  nonadditive,  interactive  effects  (e.g., 
multiplicative  ones)  can  often  be  easily  modified  into  additive  ones  so 
that  powerful  linear  mathematical  methods  can  be  applied  (Blalock,  1964). 
For  moderately  complex  causal  models  a  technique  known  as  "path  analysis" 
allows  for  the  estimation  of  the  magnitude  of  the  linkages  between  causal 
variables,  the  possible  causal  relationships  between  variables,  and  the 
direct  and  indirect  effects  of  variables  on  each  other.  Path  analysis 
also  allows  for  tests  of  the  adequacy  of  the  whole  causal  model  (Asher, 
1976). 

The  most  sophisticated  causal  models  include  time  as  a  major 
causal  variable  and  consider  the  possibility  of  feedbacks  in  the  system  of 
causes.  That  is,  the  indirect  effects  of  cause  A  on  cause  B  may  feed  back 
on  cause  A  so  that,  at  a  later  time,  cause  A  has  a  different  effect  on 
cause  B  and  on  the  overall  effects  in  the  system.  These  models  are 
labeled  "dynamic  systems"  and  usually  reqjiro  extensive  data  on  variables 
over  time. 

O'Leary  and  Coplin  (1975,  ch,  7)  developed  a  series  of 
quantitative  causal  relationships  for  State  Department  intelligence 
analysts  in  an  effort  to  forecast  the  strength  of  evolving  coalitions 
among  oil-exporting  and  oil-importi lg  countries.  They  were  attempting  to 
translate  State  Department  analysts'  hypotheses  into  quantitative  form,  so 
this  application  is  perhaps  more  relevant  to  analyst  problems  of 
hypothesis  generation  than  to  problems  of  causal  search.  However,  because 
causal  models  can  reveal  unsuspected  relations  and  invalidate  intuitive 
relations,  they  also  p^-ve  to  enhance  the  search  for  causal  patterns. 

O'Leary  and  Copiin  developed  quantitative  indices  of  internal 
cohesion  for  the  two  groups  of  nations  and  of  the  bargaining  between  the 
two  blocs.  Data  on  oil  and  nonoil  transactions  (trade)  and  on  votes  on 
political  issues  were  used  to  estimate  future  relations  between 
oil-producing  states  and  oil  companies.  These  relationships  wore  found  to 
shift  over  time,  suggesting  a  dynamic  model  of  cohesion  variables  (causes) 
on  the  bargaining  variables  (effects). 

Simplistic  perceptions.  The  last  set  of  problems  analysts  may 
have  with  causal  search  is  overly  simplistic  perceptions.  We  use  this 
terra  to  reflect  such  problems  as  "minimal  causation"  (the  tendency  to 
search  for  the  first  plausible  cause,  see  Chapter  4),  "causal  hydraulics" 
(the  tendency  to  perceive  causality  as  fixed  in  amount),  and 
reductienistic  models  (tac  tendency  to  accept  too  small  a  sot  of  causes  as 
responsible  for  an  effect).  These  problems  may  lead  the  analyst  to 
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overlook  valid  causes,  to  ignore  the  possibility  of  multiple  causes,  or  to 
see  effects  as  coming  about  in  only  one  way. 

Search  trees.  To  help  overcome  some  of  these  problems,  analysts 
might  use  ,Jfault  tree"  and  "decision  tree"  techniques.  Fault  trees  are 
diagrams  developed  by  engineers  to  determine  how  a  particular  event  (a 
fault  or  failure)  could  occur  in  a  system.  The  engineers  reason  backwards 
from  effect  to  possible  causes.  For  example,  the  engineers  may  want  to 
determine  all  the  possible  ways  an  automobile  might  fail  to  start. 

If  a  fault  tree  is  an  effort  to  answer  the  question  "how  could  a 
state  like  this  come  about,"  a  decision  tree  addresses  the  question  "given 
this  state,  where  can  events  go  from  here."  In  other  words,  a  decision 
tree  might  be  created  for  the  possible  future  actions  a  mechanic  might 
take  if  confronted  with  a  car  that  refuses  to  start.  1'ault  and  decision 
trees  are  examples  of  what  psychologists  term  p>  ■  lem-sol ving  search 
trees. 

Tree  diagrams  serve  to  systematize  suspect  relationships.  They 
also  increase  the  possibility  that  new  relationships  may  be  perceived  that 
otherwise  might  have  been  missed,  but  they  do  not,  in  themselves,  ensure 
that  all  possible  alternatives  are  included,  Possible  causes  may  bo 
omitted  from  a  fault  tree  ;nd  possible  options  may  be  left  out  of  a 
decision  tree.  There  are  no  methodological  solutions  to  this  incomplete 
specification  of  possible  causes  or  effects,  but  some  heuristic  approaches 
may  help  the  analyst  fill  out  an  initial  causal  search  tree. 

For  example,  the  analyst  might  explore  the  possibility  that  the 
possible  branches  of  the  cause  tree  are  limited  by  the  nature  of  the 
cause-effect  problems.  For  example,  the  analyst  may  be  able  to  establish 
that  there  are  only  three  groups  in  the  Soviet  Union  capable  of  changing 
the  design  program  for  Soviet  ships.  That  is,  there  may  be  a  way  to 
establish  that  the  total  possible  causes  of  an  effect  in  a  causal  search 
tree  arc  limited  to  some  finite  number.  This  number  (call  it  X)  gives  the 
analyst  a  "goal,  state"  —  e.g.,  find  X  causes  tor  the  effect.  When  the 
analyst  has  compiled  a  list  of  X  causos,  the  problem  of  completing  the 
causal  search  tree  is  done.  This  strategy  entails  first  examining  the 
general  cause-effect  problem  for  the  possibility  of  a  boundary  that 
defines  and  limits  the  number  of  possible  causes,  and  then  attempting  to 
generate  all  specific  eause-effect  relations,  rather  than  the  more  typical 
reverse  approach.  In  the  reverse  approach,  the  analyst  cannot  know  if  he 
or  she  has  reached  the  stopping  point  (i.e.,  has  exhausted  all  possible 
causes ) . 

Hany  cause-effect  problem«s,  however,  do  not  have  apparent 
boundaries  around  the  possible  branches,  and  the  tree  appears,  a  priori, 
unbounded.  The  analyst's  stopping  problem  becomes,  not  “Are  these  all  the 
possible  causes,''  but  rather  "Are  these  all  the  possible  causes  worth 
investigating?" 

Psychologists  studying  problem-solving  behavior  have  identified 
two  types  of  impediments  to  search  tree  construction.  One  impediment, 
“functional  fixedness,"  entails  representing  objects  by  their  conventional 
functions  and  failing  to  consider  the  objects'  novel  functions.  An 
analogous  block  might  be  termed  “event  fixedness,"  the  tendency  to 
consider  only  conventional  causes  for  events  rather  than  novel  causes.  A 
related  impediment  results  from  "set  effects,"  the  tendency  to  attuck  a 


problem  with  one  approach  or  method  and  not  to  change  that  approach. 

An  example  ot:  "set  eifccta"  might  be  a  mechanic,  attempting  to 
determine  the  causes  of  an  automobile’s  iailurc  to  start,  thinking  in 
terms  of  electrical  problems  (dead  battury,  wet  spark  plugs,  bad 
distributor),  but  not  in  terms  of  fuul  problems  (empty  gas  tank,  blocked 
fuel  line,  broken  fuel  pump).  An  example  of  “event  fixedness"  might  be 
the  mechanic  who  fails  to  realize  that  cars  may  not  start  for 
nonmechanical  reasons  (e.g.,  attempting  to  turn  the  ignition  key  the  wrong 
way,  attempting  to  start  while  the  automatic  transmission  is  set  to 
“drive"). 

One  escape  from  functional  fixedness  is  to  attach  specific  labels 
to  objects  and  parts  of  objects.  These  labels  allow  people  to  mentally 
connect  objects  to  different  purposes  that  they  might  not  consider  when 
presented  with  the  objects  alone  (see  Posner,  1973;  154-158).  This 
suggests  that  naval  analysts  should  change  perspectives  and  "disassemble" 
the  naval  events  they  seek  to  explain  with  causal  trees  and  attach 
specific  labels  to  the  different  perspectives  or  the  component  parts  of 
the  event.  These  labeled  perspectives  or  parts  would  then  perhaps  suggest 
more  possible  causes  for  the  event  than  would  occur  to  the  analyst  who 
only  considered  the  event  as  a  whole  entity  from  a  single  perspective. 

This  labeling  hypothesis  suggests  that  efforts  by  naval  analysts 
to  create  event  taxonomies  which  specify  important  features  of  events 
(e.g.,  McConnell's  “rules  of  the  game"  effort,  Dismukes  and  McConnell, 
1979,  eh.  7)  tire  highly  heuristic  because  the  various  features  way  suggest 
new  perspectives  and  novel  causes  to  the  analysts  building  causal  search 
trees.  The  ©ore  various  the  ways  analysts  are  able  to  label  or  code  an 
event,  the  more  various  the  possible  causes  the  analysts  are  likely  to 
consider  as  relat'd  to  that  event.  Similarly,  schemes  which  classify  the 
subevents  of  an  event  (e.g.»  pre-crisis,  crisis-buildup,  height  of  crisis, 
pest-crisis,  return  to  status  quo)  should  facilitate  building  causal 
search  trees.  The  wore  classification  sehoa.es  the  analyst  can  consider 
(e.g.}  dimensions  of  time,  tension,  geography,  actors,  institutions, 
technologies  are  just  seme  of  the  possible  bases  tor  grouping  subevents), 
the  richer  the  set  of  causes  the  analyst  Is  likely  to  consider. 

Several  of  the  mechanisms  As choc  (1978)  suggested  for 
surprise-sensitive  forecasting  (see  Chapter  4  “Prediction"),  e.g.i 
suspension  of  plausibility  cheeks,  may  facilitate  expanding  the  branches 
of  the  causal  search  tree. 

The  phenomenon  of  “tunnel  history,"  which  Fischer  (1970)  lists  as 
a  problem  with  narrative  analysis  (see  Chapter  4,  "Narrative  Logic"),  is  a 
set  effect.  That  is,  explaining  naval  events  as  duo  to  naval  causes 
limits  the  building  of  the  causal  search  tree.  The  interdisciplinary 
approach  taken  by  many  of  Che  sampled  naval  analysts  is  likely  to  reduce 
the  tendency  toward  set  effects,  but  analysts  might  enhance  this  positive 
effect  by  directly  involving  analysts  from  different  disoipl.  les  In  the 
causal  tree  construction  and  evaluation  process. 

Tree  problems.  Psychological  research  on  fault  trees  (Fischhoff, 
Slovie,  and  Lichtenstein,  1978)  shows  that  analysts  will  not  typically 
notice  the  omission  of  important  causal  branches.  For  example,  Fischhoff 
and  his  colleagues  showed  people  (including  auto  mechanics)  various 
versions  of  a  fault  true  tor  the  problem  of  the  uoustarting  car,  and  asked 
for  estimates  of  the  proportion  of  no-starts  caused  by  the  category  "ail 
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other  problems.”  As  various  causal  branches  (e.g.,  fuel  system)  are 
deleted  from  the  tree,  the  proportion  of  no-stnrts  attributed  to  "all 
other  problems”  should  increase.  It  did  not.  People  seemed  not  to  miss 
the  absence  of  important  causal  branches,  and  seemed  unable  to  appreciate 
how  many  causes  had  been  omitted  from  the  pruned  fault  trees.  In  other 
words,  there  was  a  faulty  tendency  to  overestimate  the  completeness  of 
incomplete  causal  diagrams.  Neither  self-rated  knowledge  nor  years  of 
mechanical  experience  improved  the  ability  to  detect  this  incompleteness. 

Fischhoff  and  his  colleagues  found  somewhat  greater  sensitivity  to 
incomplete  fault  trees  when  people  were  explicitly  urged  to  consider  the 
tree’s  completeness  and  think  about  possible  causes  that  might  be  left 
out.  In  this  case  people  were  more  likely  to  estimate  that  causes  were 
missing,  but  even  these  estimates  tended  to  be  low,  i.e.,  there  were  more 
causes  missing  than  even  this  sensitized  group  estimated. 

These  results  suggest  that  analysts'  etforts  to  fill  out  and 
elaborate  a  causal  search  tree  are  probably  well-spent  and  will  tend  to 
pay  off  in  possible  causes  that  would  otherwise  be  overlooked.  The*  issue 
still  open,  however,  is  how  the  analyst  can  determine  the  point  to  stop 
searching  for  causes. 

Stopping  problem.  While  efforts  to  overcome  impediments  to  causal 
search  tree  construction  will  reduce  the  chances  that  naval  analysts  will 
overlook  important  causes,  they  do  not  solve  the  stopping  problems 
knowing  when  the  causal  tree  is  sufficiently  completed.  This  is 
essentially  a  problem  of  induction  and  information  integration:  given  a 
rich  causal  tree,  does  the  evidence  suggest  that  some  subset  of  the 
possible  causal  branches  is  an  adequate  or  satisfactory  explanation  of  the 
event. 

Two  methods  which  help  analysts  with  this  stopping  problem  were 
noted  above  under  "Weighting  Data”;  bayesian  techniques  and  linear 
modeling.  Linear  models  are  the  basis  tor  most  causal  modeling  approaches 
and  may  be  the  most  compatible  method  for  assessing  whether  the  cause  tree 
seems  sufficiently  complete.  The  statistics  of  causal  analysis  techniques 
allow  the  analyst  to  estimate  unexplained  variance,  which  eorresg&uds  to 
the  role  of  undetermined  causes,  if  unexplained,  variance  is  too  high  (an 
analytic  Judgment  must  bo  made  as  to  what  “too  high"  means),  the  causal 
tree  is  incomplete  and  the  eaiml  search  should  continue. 

The  use  of  Bayesian  techniques  allows  the  analyst  to  estimate  the 
likelihood  o£  an  c\‘ent  given  various  causes,  and  to  estimate  the 
subjective  probability  that  any  causal  explanation  of  the  event  is  true- 
If  the  analyst  finds  hit  or  her  subjective  probabilities  for  the  various 
causal  explanations  are  all  too  law  (again,  “too  low**  requires  an  analytic 
judgment),  the  causal  search  is  incomplete. 

One  of  the  more  wide-spread  uses  of  Myesian  techniques  in  causal 
analysis  takes  place  in  medical  diagnosis  (see  e.g«,  Curry,  et  al»,  19?1; 
Lusted,  IMS;  McNeil,  ec  al.,  19)5;  and  Schwarts,  el  a! . ,  1973).  incision 
aided  medical  diagnosis  makes  use  of  decision  trees  which  specify  the 
possible  actions  and  tests  the  physician  can  take  and  their  possible 
consequences  for  a  patient  with  one  of  seven!  possible  &a ladies.  Bayesian 
techniques  are  used  to  evaluate  the  physician's  subjective  probability 
estimates  that,  given  certain  tost  results  and  symptoms,  Che  patient’s 
malady  is  caused  by  one  disease  rather  than  another.  As  further 
information  on  teats  or  patient  response:;  to  treatment  is  acquired  (i.e., 
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as  the  physician  and  patient  wove  to  different  nodes  in  the  decision  tree) 
Bayes  formula  can  he  used  to  update  the  physician's  estimates  of  the 
probabilities  of  various  causes.  Bayesian  techniques  are  especially 
useful  in  compensating  for  the  tendencies  to  overemphasize  case  data 
(e.f».t  a  positive  test  result)  and  to  underweight  base-rate  data  (e.g., 
the  incidence  of  the  disease  in  the  population  at  large). 

Bayesian  techniques  do  not  handle  effectively  situations  where 
multiple  causes  are  operating,  e.g.,  a  patient  with  two  disorders  of 
overlapping  nature.  However,  it  is  for  just  such  situations  that  causal 
modeling  was  developed.  Similarly,  Bayesian  techniques  may  be  less 
effective  in  cases  where  causes  change  over  time.  Dynamic  systems 
modeling,  however,  is  a  means  for  attacking  this  problem.  This  suggests 
that  the  selection  of  a  particular  analytic  aid  for  a  causal  analysis 
problem  is  likely  to  bo  an  heuristic,  experimental  process.  The  “right" 
aid  may  not  be  the  first  one  selected.  An  experimental  approach  to  aids, 
i.e.,  a  willingness  to  try  various  types  and  combinations  may  be  required 
(Krischer,  1980). 

Hypothesis  Generation 

mtmrnmmmmtmmm  i  . . .  mmtm 

In  Chapter  4  we  reviewed  several  biases  in  the  process  of  causal 
hypothesis  generation,  i.e.,  the  tendency  to  generate  soma  types  of  causal 
explanations  and  not  others.  We  also  noted  in  Chapter  4  the  ease  with 
which  people  (including  scientists  using  sophisticated  cause  assessing 
methods)  could  detect  a  “presumptive  agency"  connecting  a  suspected  cause 
with  an  effect  and  find  confirming  evidence  for  this  hypothesis,  even  when 
It  was  false, 

In  contrast  to  the  search  approach  to  causal  analysis,  which 
emphasized  recognition  and  organization  of  pattern  features  in  data  ants, 
the  hypothesis  gene  rat  ion  approach  focuses  en  the  logical  generation  of 
hypotheses,  their  test,  and  subsequent  revision.  Hypothesis  generation 
problems  then  are  likely  to  occur  at  either  the  generation,  test,  or 
revision  phases,  tte  will  discuss  the  latter  two  problem  areas  later,  when 
we  consider  theories,  tn  the  present  section  we  consider  hypothesis 
generation  problems. 

The  biases  in  causal  hypothesis  generation  described  in  Chapter  4 
tend  to  fall  into  two  groups:  those  that  are  largely  dua  to  cognitive 
processes  and  those  that  appear  to  be  based  on  assumptions  about  causality 
in  social  relationships.  The  cognitive  problems  seem  to  occur  because 
certain  features  of  the  information  stored  in  memory  about  effects  and 
possible  causes  tend  to  suggest  certain  causal  explanations  (which  may  be 
inappropriate).  When  these  data  features  are  largely  social  (e.g. >  a 
liked  actor  versus  a  disliked  actor),  the  hypothesis  generation  problem 
can  be  labeled  social,  although  it  may  have,  at  a  more  abstract  level,  a 
cognitive  basis. 

Cognitive  problems.  Three  types  of  bias  were  reviewed  in  Chapter 
4  which  may  lead  the  analyst  to  generate  faulty  causal  hypotheses: 
fundamental  attribution  error,  representativeness,  and  determinism. 

The  fundamental  attribution  error  is  the  tendency  to  attribute 
behavior  to  correspond ing  personal  dispositions  of  the  actor  and  not  to 
environmental  causes,  tn  large  parr  this  tendency  is  due  to  focusing  of 
attention  and  to  the  representativeness  heuristic.  The  focusing  of 
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attention  on  an  object  (or  actor)  increases  the  likelihood  that  the  object 
of  attention  will  be  perceived  as  causing  events.  The  representativeness 
heuristic  refers  to  the  tendency  to  look  for  causes  whose  principal 
features  match  those  of  the  effect.  Determinism  is  the  tendency  to  seek 
nonprobabllistic  causes  for  phenomena  and  to  not  consider  the  possibility 
of  causal  forces  that  have  probabilistic  effects. 

An  actor  is  typically  the  center  of  attention,  and  thus  is  seen  as 
causal,  and  the  causes  of  the  effects  produced  by  the  actor  are  typically 
deemed  to  have  originated  with  the  disposition  of  the  actor  rather  than 
with  the  pressures  of  the  environmental  background. 

This  distinction  between  dispositional  (or  internal)  sources  of 
behavior  and  environmental  (or  external)  sources  is  one  of  considerable 
importance  for  naval  and  military  analysts.  Did  the  Soviets  become 
involved  in  this  crisis  because  of  their  overall  plan  to  destabilize  the 
region  (internal  cause)  or  because  their  client  state  is  threatened  by  a 
Western  client  (external  cause).  Did  the  Soviet  naval  construction  plan 
change  in  response  to  Soviet  geopolitical  strategy  (internal)  or  in 
response  to  naval  threats  from  their  adversaries  (external).  To  what 
extent  are  Soviet  actions  due  to  a  mixture  of  internal  and  external 
causes? 

Social  scientists  have  developed  an  extensive  and  elaborate  set  of 
quantitative  methods  to  deal  with  one  form  of  this  causal  problem; 
determining  the  causes  of  arms  races.  These  methods  could  be  extended  to 
efforts  to  model  crisis  interactions,  diplomatic  penetrations,  aid  for 
conflicting  client  states,  etc.  In  our  sample  of  naval  estimates  none  of 
the  various  dynamic  arms  models  were  used. 

It  is  somewhat  surprising  for  two  reasons  that  nene  of  the  naval 
analysts  sampled  used  quantitative  arms  race  models  in  their  analyses. 
First,  the  naval  analysts  themselves  (e.g,,  Bowen,  NPSj?,  ch .  A) 
occasionally  drew  parallels  between  previous  naval  races  end  the 
Soviet'- American  naval  rivalry.  For  example,  Bowen  (p.  57)  deseribea  the 
circumstances  of  the  current  Soviet-Aaerican  naval  balance  as 

.  .  .  similar  to  those  that  prevailed  at  the  beginning  of 
the  century  when  Germany  challenged  the  supremacy  of 
Britain's  navy. 


Second,  many  arms  rivalries  in  the  19th  and  20th  centuries  have 
been  naval.  Huntington  (195S)  listed  thirteen  arms  races  in  this  period, 
of  which  seven  and  a  third  were  naval  (the  third  of  %  ease  is  tne  nuclear 
competition  of  the  United  States  and  USSR).  While  Huntington's  list  may 
not  he  exhaustive,  it  is  quite  likely  that  the  high  proportion  of  naval 
races  would  be  found  in  a  more  complete  list.  Certainly,  one  could 
conclude  that  about  half  of  the  atajor  arts#  races,  foe  which  social 
scientist#  have  developed  quantitative  analytic  oodels,  have  been  naval. 

Two  wain  advantages  of  arms  race  models  are  that  they  Cl)  make 
note  explicit  and  asathe«at ieal iy  precise  the  analyst’s  implicit 
assumptions  and  intuitive  hypotheses  about  atss  competition,  (2)  provide  a 
cleat  distinction  between  foreign- induced  and  self  "induced  forces  in  a 
nation's  at»s  program  (Genteel,  1973’  Wallace  and  tfiison,  1978).  Other 
aspects  of  the  nature  of  arss  competition  ran  he  included  in  these  ssadels, 
e.g.,  whether  the  states  involved  are  competing  in  number*  or  technology 
or  both  (e.g.,  hoi list,  1972;  Huntington,  1958;  huteibacher ,  1976).  It  is 
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also  possible  to  model  an  arms  competition  I  tween  two  nations  (e.g.,  the? 
United  States  and  the  USSR)  at  the  same  time  that  competition  between 
pacts  and  alliances  are  examined  (o.g.,  NATO  and  Warsaw  I'act  ,  see, 
Hettinger,  1975;  Wallace  and  Wilson,  1978).  That  Is,  there  may  be 
alliance  or  pact  causal  factors,  as  well  as  intranet  tonal  and 
international  causes  for  arms  competition.  Arms  models  also  help  the 
analyst  avoid  "mirror  Imaging."  That  is,  while  one  state  may  he  reacting 
largely  to  its  competitor's  behavior,  the  competitor  state  may  be 
responding  primarily  to  internal  forces.  "Mirror  imaging"  is  the  bias 
coward  perceiving  such  situations  as  symmetrical,  i.e.,  both  competing 
states  are  reacting  to  the  same  kinds  of  factors.  Several  arms  race 
modelers  (e.g.,  Hollist,  1977;  Luterbacher,  1976;  Rattinger,  1975;  Wallace 
and  Wilson,  1978)  using  different  models  and  various  data  sets  all 
essentially  concluded  that  while  the  USSR's  arms  and  especially  its 
strategic  missile  programs  were  reactive  to  Western  (especially  United 
States)  arm?,  the  United  States'  programs  were  not  symmetrical:  U.S- 
programs  showed  more  reaction  to  internal  forces  (cost,  technology, 
previous  arms  spending)  than  did  the  Soviet  programs.  It  is  a  mistake  to 
dismiss  arms  race  models  (as  does  Uohlstetter,  1975:  47)  simply  because 
the  two  nations  involved  do  not  behave  in  exactly  the  same  (or  a 
symmetrical)  way.  In  fact,  it  is  because  the  nations  may  not  be  reacting 
identically,  or  responding  to  forces  which  are  the  mirror  image  of  each 
other,  that  arms  race  models  are  particularly  helpful. 

Kxplieit  models  of  arms  competition  may  yield  some  useful 
predictive  indicators  as  well  as  systematize  the  analyst’s  reasoning  on 
causal  factors.  For  example,  Wallace  (1979)  found  that  the  product  of  the 
smoothed  rate  of  arms  increases  for  pairs  of  disputatious  nations 
predicted  whether  war  would  follow  the  arms  competition.  Rapidly 
accelerated  arms  races  escalated  to  war  in  23  out  of  28  cases,  while 
disputes  not  preceded  by  accelerating  arms  competition  resulted  in  war 
only  3  times  out  of  71  cases. 

An  egeolltmt  ©sample  of  quantitative  mm  mm  omtelieg  combined 
with  detailed  qualitative  descriptive  analysis  l*  bawho lot's  throa-parfr 
series  w  the  Auglo-Ootman  Dreadnought  *«*<?;*  (1974,  1976), 

(!9?6:  SO)  presented  a  diagram  (Figure  S.t)  illustrating  how  His 
traditional  analysis  and  his  numerical  methods  were  integrated  in  his 
study.  His  approach  reinforces  the  point  made  here  that  quantitative 
assessments  of  causal  factors  ear  be  a  useful  tool  far  determining  the 
causes  of  a  nation's  naval  objective*. 

Social  grahlegi.  two  types  of  causal  problems  can  he  related  to 
the  tendency  to  generate  causal  hypotheses  ©a  the  basis  of  social 
intuitions,  One  of  these  problems  was  the  tendency  to  attribute 
motivational  causes  when  cite  consequences  of  actions  are  more  foreseeable. 
Actors  who  are  perceived  as  able  to  foresee  the  consequences  »f  their  acts 
were  also  perceived  as  ware  cultivated  (rather  than  pressured  by  esternal 
forces)  to  bring  those  consequences  about. 

A  second  problem  of  social  perception  of  causes  is  the  tendency  to 
attribute  the  "g©od“  actions  (those  approved  of  by  the  observer)  of  liked 
actors  to  dispositions  and  of  disliked  actor*  to  luck,  chance,  or 
situation,  on  the  one  hand,  and  to  attribute  *bad“  actions  Of  liked  actors 
to  luck,  chance,  or  situation,  and  of  disliked  actors  to  dispositions, 
Disliked  actors,  in  other  words,  tend  only  to  be  Seen  as  planning  bad 
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Figure  5.2.  Lanibelet's  Approach  to  Qualitative  and  Quantitative  Aspects  of 
the  Anglo-German  Dreadnought  Race.* 


action**  an*l  as  being  forced  (or  stumbling  accidently)  into  good  actions. 

fhc  not hods  out  lined  above  in  this  section  for  systematising 
causal  hypotheses  should  assist  the  analyst  to  avoid  these  social  cause 
biases.  Another  technique  was  outlined  in  Chapter  4:  Kelley’s  consensus, 
consistency,  and  distinctiveness  method,  this  method  can  be  viewed  as  a 
special  form  of  causal  model  aimed  at  the  statistical  features  of 
dispositional  and  situational  causes  of  actions. 

PHEOlCtXOM$ 

t’aresasting  would  be  an  absurd  enterprise,  were  it  not 
inevitable. 

Bertrand  de  Jouvouei, 
the  Art  of  Conjecture 

Maval  analysts  sc«a  to  share  many  of  the  same  problems  experienced 
by  other  forecasters,  in  Chapter  2  we  noted  "hat  r*n  relative  lack  of 
specific  predictions  by  naval  analysts  made  it  impossible  in  this  study  to 
systematically  assess  the  prediction,  or  forecasting  crack  records  of  naval 
analyses.  Such  assessments  are  an  .excellent  means  tor  providing  the 
analyst  with  self  •'correcting  feedback,  this  suggests  that  naval  analysts 
could  improve  their  prediction  and  forecasting  efforts  b;  (1)  frequently 
making  specific  and  precise  predictions,  (2)  regularly  comparing 
prediction*  to  outcomes  and  assessing  the  frequency,  magnitude,  and 
direct  ten  of  errors,  and  C  5 )  using  this  track  record  feedback  to  modify 
their  prediction/foeecasting  methods. 

because  analysts  now  tend  t©  make  vague,  balghie.  forecasts  or 
Aesopian  estimates,  it  is  difficult  or  impassible  to  gauge  the  analyst's 
accuracy,  this  leaves  analysts  with  a  very  subjective  impression  of  their 
.estimation  trick  record  and  the  possibility  that  analysts,  with  the 
advantage#  el  hindsight,  will  perceive  their  past  track  records  so  more 
precise  and  predictive  than  they  ty.  were.  A  subjective, 

retrospective  approach  to  seif -appraise!  is  unlikely  to  yield  th*  derailed 
feedback  Information  m  inaccuracy  that  analysts  could  use  to 
#y#t@ssat ice!  ly  improve  their  method#. 

Ment  IfyiAs  Agfurngt Ions 

A  stain  problem,  noted  in  Chapter  4,  preventing  agentacy  in 
forecasts  and  predictions  is  the  central  role  of  the  forecaster*# 
ion#  i&scher,  A  carsfnl  and  systematic  prospective 

assessment  of  the  prediction  track  record  can  assist  the  analyst  to  refine 
as snaps lend. 

leek  c  a  ?  1 1  A!*  >  A  related  strategy  is  to  employ  frequent 
^hacfeceoting  exercises"  to  determine  whether  the  assumptions  underlying 
the  forecast  are  true  for  past  and  present  data  f&sener,  l$t|; 
Horgeostero,  Knott,  and  holes ,  1§?3K  as  ftsehar  noted  fp.  SI  forecasters 
often  fail  so  cyanine  the  biases  of  their  predecessors  and  neglect  to 
adjust  their  forecasts  In  a  direction  that  vetsld  rectify  earlier 
forecasts,  he  wrote  Ip.  1101: 
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.  .  .  the  use  of  previous-error  feedback  is  lacking  in  the 
forecasting  efforts  in  every  area  except  that  of  certain 
short-term  econometric  forecasting  models. 

This  nonuse  of  error-correction  feedback  use  seems  due  to  the  forecasters' 
beliefs  that  their  assumptions  about  the  future  already  incorporate  all 
the  data  pertinent  to  known  trends.  In  many  cases,  however,  the 
forecasters'  methods  cannot  accurately  predict  known  trends,  let  alone  the 
unknown  future. 

The  failure  of  intelligence  analysts  to  backcast  has  been  noted 
several  times  in  connection  with  the  underestimation  cf  Soviet  strategic 
missile  inventories  (Sullivan,  in  Godson,  1980;  Wohlstetter,  1975a),  i.e. , 
estimators  continued  to  underestimate  capabilities  even  after  evidence  of 
past  underestimates  were  noted,  including  a  warning  from  Soviet  leader 
Brezhnev  that  the  West  was  undercounting!  Among  the  explanations  for  this 
persistent  underestimation  of  capabilities  is  the  hypothesis  that  U.S. 
intelligence  analysts  had  oisperceived  Soviet  strategic  intentions  and 
requirements,  and  had  “mirror-imaged"  the  Soviet  intentions  to  correspond 
to  our  own  (e.g.,  see  Sullivan,  in  Godson,  1980;  62). 


A  second  technique  that  can  help  ar.alyrts  to  clarify  their 
assumptions  is  bootstrapping.  That  is,  a  quantitative  model  of  the 
analyst's  predictions  is  constructed  using  the  data  inputs  considered  by 
the  analyst  and  fitting  these  variables  to  the  analyst's  predictions - 
This  model  of  the  analyst  will  reflect  the  data  variables  that  most 
influenced  the  predictions,  thus  providing  the  analyst  with  quantitative 
information  on  the  ingredients  of  hie  or  her  predictions >  By  knowing 
which  variables  most  heavily  influence  his  predictions  the  analyst  can 
bettor  assess  his  prediction  assumptions. 

Two  of  the  quantitative  studies  done  by  O'Leary  mi  Co pi  in  (1975) 
for  State  Department  intelligence  analysts  used  a  quasi -bootstrapping 
approach  toward  improving  predictive  capability  (although  it  was  not 
identified  as  bootstrapping  by  the  authors).  In  one  effort  (“Predicting 
political  instability  in  tropical  Africa, “  eh.  2,  O'Leary  mid  Copiin, 
19?$)  they  evaluated  the  view*  of  State  Department  analysts  on  the  causal 
variables  leading  to  pouttuai  inacaUliivy  *.»  U'vpivS*  African  nctir-f, 
from  the  analysts'  narrative  analyse®,  O’Leary  and  CmpUn  abstracted  a 
variety  of  byothasired  causal  factors.  These  factors  were  thus  quantified 
mi  regressed  on  measures  mf  polities I  instability,  (Had  ths  study  been  a 
truly  bootstrapping  ftlfort,  the  variable*  would  fee  regressed  on  analysts* 
predictions  ef  political  instability,  yielding  a  made!  of  the  analysis* 
predictions,  the  O'Leary  and  Sepiin  approach  was  to  develop  a  »«4el  of 
the  situation,  but  the  same  techniques  canid  fee  used  in  a  bsatnt rapping 
effort-  Both  model  building  techniques  aid  the  analysts  fey  explicitly 
relating  variable*  to  predictions,  thus  clarifying  assumptions.}  O'Leary 
and  ©aplin  (eh*  §>  followed  a  similar  approach  in  their  effort  to  develop 
a  quantitative  made!  m  prediet  violence  in  the  Middle  last.  In  this  case 
the  State  Department  analysts*  prelections  (i.e.,  forecasts  and 
ptedieiiesi  of  Middle  Bast  violence)  were  the  predicted  variables,  and 
©'Leary  and  Cop* in  attempted  to  mathematically  relate  eve  tv:  data  set 
measures  to  the  analysts*  projections.  The  analysts*  projections  of 
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violence  were  closely  related  to  the  weekly  and  monthly  frequencies  of 
violent  acts  in  the  area.  In  effect,  the  analysts'  projections  of 
violence  in  the  future  were  strongly  influenced  by  the  frequency  of 
violence  in  the  past  week  and  month. 

O'Leary  and  Coplin's  analysis  included  an  outline  of  an  assessment 
technique  to  tost  the  validity  of  the  analysts'  assumptions  as  revealed  by 
the  quantitative  model,  which  seems  to  be  one  of  the  more  useful 
consequences  of  bootstrapping  the  analysts'  predictions. 

Sensitivity  Testing 

Other  problems  noted  in  Chapte  4  were  the  tendencies  to  overweight 
case  data  and  underweight  base-rate  data  in  predictions,  and  the  tendency 
to  overestimate  the  predictive  validity  of  indicator  variables.  A  partial 
antidote  to  these  tendencies  is  sensitivity  testing,  that  is,  asking  the 
analyst  to  consider  how  her  or  her  predictions  would  be  different  if  the 
base  rates  were  vastly  different,  or  if  the  predictive  validity  of  the 
indicators  were  varied.  These  sensitivity  exercises  tend  to  make 
predictions  more  regressive  (i  e.,  closer  to  the  normative  statistical 
predictions,  see  Fiachhoff,  Slovic,  and  Lichtenstein,  19/9).  Sensitivity 
tests  seem  to  lead  to  greater  attention  to  the  predictive  and  diagnostic 
power  nf  the  variables  used,  and  predictions  more  in  line  with  this 
awareness. 

Validity  of  Future  Assumptions 

The  main  conclusion  of  Aseher's  (19781  and  Merganstevn,  Knurr,  and 
Hoisa *  (1972)  evaluations  of  forecasting  is  that  forecasting  accuracy  is 
dependent  m  the  validity  in  the  future  of  the  central  assumptions  made  hy 
the  forecaster,  The  variable*  «VieeVed  by  tUtf  forecaster  may  he  adequate 
to  explain  past  events,  but  the  future  structure  of  the  problem  may 
change,  making  these  variables  less  important.  The  techt, tques  described 
above,  assessing  the  prediction  stack  record,  baekeaating,  bootstrapping, 
and  sensitivity  testing,  help  the  analyst  determine  his  or  her 
assumptions,  and  assess  their  validity  if.  the  pant,  but  they  do  little  to 
aid  the  analyst  to  assess  the  validity  of  those  assumptions  in  the  future* 
To  the  degree  that  future  trends  tend  to  reflect  past  trends,  these 
technique*  help  the  analyst  so  make  systematic  ptvjectiwes.  Sac  if  the 
future  is  unlike  the  past  and  full  of  major  surprises,  upheavals,  and 
revolutionary  events;  the  past,  and  methods  which  help  the  forecasting 
analyst  sake  systematic  use  of  the  past,  is  of  such  less  value* 

pimple  Hedeis  and Jhirprlsing  yntures 

The  widespread  finding  that  relatively  simple  actuarial  and 
economatrls  eedeis  outpred let  the  forecasts  of  human  estimators  In  the 
short  and  m&im  tors  (gee  Chapter  4  “Prediction")  suggests  that  analysts 
should,  as  a  minimum,  develop  a  simple,  quantitative  modei  of  the 
phenomenon  they  are  attempting  to  prediet,  fait  simple  model  should  he 
validated  an  past  evidence  and  used  as  a  baseline  against  which  the 
analyst  can  attempt  to  refine  and  “fine “tune"  estimates.  The  baseline 
model  would  rotve  to  highlight  those  particular  facta  and  reasons  the 
analyst  believes  the  future  will  not  be  a  simple  extrapolation  fsea  the 


past.  By  serving  as  a  validated  representation  of  the  “surprise  £reeM 
future,  the  simple  model,  in  effect,  enables  the  analyst  to  concentrate  on 
those  forces  and  developments  that  may  cause  surprises.  To  the  degree 
that  the  future  is  like  the  past,  the  simple  model  will  do  the  best  job  of 
extrapolating  the  important  variables.  But  the  model  lacks  the  analysts' 
insights,  experience,  and  intuitions  about  new  trends,  incipient 
developments,  sudden  variations,  changes  in  context  or  tone.  These  subtle 
cues  can  only  be  appreciated  by  the  analyst,  and  the  use  of  a  baseline  , 
"surprise-free"  model  may  allow  the  analyst  the  opportunity  to  pursue 
these  leads  to  the  surprising  future. 

A  Science  Analogy 

A  useful  analogy  can  be  drawn  betwee.n  the  situation  described  in 
the  preceding  section  and  Kuhn's  (1970)  sociological  description  of 
“normal"  science  and  "revolutionary"  or  "paradigm  shift"  science.  Normal 
science  is  the  use  of  proved  and  accepted  scientific  methods  to  solve 
problems  and  puzzles  which  bear  importantly  on  a  scientific  field. 
Problems  are  attacked  that  are  widely  believed  to  be  solvable  and,  once 
solved,  become  important  parts  of  a  major  scientific  theory.  Kuhn  has 
much  more  to  say  about  normal  science,  but  the  point  here  is  that  it  is 
analogous  to  the  development  and  use  of  simple  quantitative  models  to  deal 
with  the  "surprise-free"  aspects  of  prediction.  Such  models  provide  a 
means  to  make  accurate  extrapolations  from  past  evidence  into  the  future 
using  agreed-upon  methods  and  data  to  solve  important  prediction 
problems. 

A  scientific  revolution  occurs  when  a  major  scientific  theory  is 
changed,  i,e,,  the  scientific  paradigm  shifts.  This  means  that  the 
interpretations  of  relationships  observed  in  the  past  are  changed,  viewed 
from  a  completely  new  perspective,  and  given  a  diff  rent  meaning.  Such 
shifts  come  about,  Kuhn  believes,  because,  in  the  course  of  normal 
science,  new,  surprising  and  unexpected  phenomena  are  constantly 
uncovered*  Such  anomalies*  as  Kuhn  labeled  them,  are  unexplainable  or 
even  uninterpretable  within  the  context  of  the  extant  paradigm.  Far  most 
scientists  they  are  not  important  problems  because  they  tail  outside  most 
of  the  categories  and  classification  schemes  of  the  paradigm*  Either  the 
anomaly  seems  unsoivaoic  within  mu?  iwt?  or  rwft**w* 

of  the  paradigm*  or,  no  interpretable  solution  seems  possible,  or  the 
anomaly  is  interpreted  as  a  part  of  the  paradigm  after  all. 

Kuhn  argued  that  anomalies  tend  to  accumulate,  however,  and  he 
wrote  < 1970s  S2>  » ‘ 

*  *  *  the  scientific  enterprise  has  developed  a  uniquely 

powerful  technique  for  producing  surprises  of  this  sort. 

The  buildup  of  surprises  and  anomalies  leads  to  a  blurring  of  the  paradigm 
and  a  loosening  of  the  informal  rules  for  normal  research* 

Eventually,  normal  science  experiences  a  crisis,  and  a  fu«dava@ntal 
shift  of  perception  and  belief  occurs  as  scientists  accept  a  new  theory  to 
interpret  both  the  old  paradigm  and  the  accumulated  anomalies*  This  new 
theory,  developed  in  large  part  from  the  effort  to  explain  the  surprises 
generated  from  normal  science,  reorganises  how  the  old  data  and  the  new 
anomalies  are  perceived  and  organised.  Scientific  theory  is  transformed. 
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Many  features  of  the  old  Interpretation  remain,  but  the  entire  situation 
receives  a  new  interpretation. 

the  use  of  simple  quantitative  prediction  models  in  nnvul  analysis 
is  likely  to  "solve"  many  normal  prediction  problems  as  well  us  generate 
many  anomalies  and  surprises.  The  naval  analyst  should  be  especially 
concerned  with  these  unusual  discoveries  and  should  attempt  to  reformulate 
the  concepts  and  categories  used  to  explain  the  situation  so  as  to 
incorporate  the  anomalies.  These  efforts  may  lead  to  a  crisis  between  the 
new  interpretation  and  the  simple  models,  which  may  lead  to  a  revolution 
and  paradigm  shift,  i.e.,  a  new  theoretical  view  of  Soviet  naval 
intentions.  If  this  new  theory  is  successful  in  accounting  for  the 
anomalies,  it  can  be  the  basis  for  a  new  set  of  simple  quantitative  models 
(although  those  will  be  significantly  different  from  the  succeeded 
models).  The  new  models  will,  like  the  old,  generate  both  solutions  and 
new  anomalies. 

The  predictive  advantages  of  using  a  normal  science/simple  model 
and  revolutionary  seivntist/analytic  speculation  system  is  that  the 
analyst  is  focusing  on  surprises,  anomalies,  a *»d  the  unexpected,  but  is 
"backed-up"  by  a  reliable  theoretical  base.  The  normal  theoretical  base 
of  the  simple  models  will  cope  with  "surprise-free"  situations,  freeing 
the  analysts  to  develop  new  frameworks  to  incorporate  those  elements  of 
the  present  (anomalies)  that  betoken  the  surprises  of  the  future.  Many 
anomalies  will  have  no  scientific  relevance,  they  will  hu  data  collection 
errors,  deceptions,  accidents,  noise  in  the  analytic  channels,  etc. 
Distinguishing  between  the  meaningless  anomalies  and  those  that  signal  the 
trends  of  the  future  is  a  major  task.  The  use  of  simple  modeling  of 
normal  theories  and  a  "surprise- 1 tee"  future  sight,  free  the  analyst  to 
create  the  now  theories  needed  to  anticipate  a  surprising  future. 

THEORIES 

tile  is  the  art  of  drawing  sufficient  conclusions  from 

insufficient  premises. 

Samuel  Sutler,  Mo| ebooks 

there  is  nothing  like  a  theory  for  blinding  the  wise. 

the  hr Hun l  of  Richard  geyerel 

■■.■■■f  i  m<f,.rn  ■uw^i.'VUniif 

In  Chapter  6  «e  reviewed  evidence  that  people  C including 
scientists)  are  extremely  reluctant  to  give  up  a  useful  theory.  This 
reluctance  extends  to  situations  in  which  considerable  evidence 
discrediting  the  theory  is  available,  and  theories  may  survive  even  a 
complete  diseoof treat ion  of  their  evidentiary  bases. 

This  seess  to  be  due  'o  several  factors.  Theories  serve  functions 
other  than  accurate  prediction.  People  are  reluctant  to  dismiss  a  useful 
theory  on  the  basis  of  evidence  that  might  be  etrenanus.  Negative 
evidence  is  difficult  to  integrate  into  a  theory.  Multiple  hypothesis 
testing  is  extremely  difficult  to  conduct.  People  tend  to  seek  and  accept 
confirming  evidence  mote  readily  titan  refuting  evidence. 
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Despite  such  difficulties  a  few  of  the  sampled  naval  analysts  did 
employ  multiple  hypothesis  testing  or  disconf irmation  strategies,  and 
several  analysts  seemed  alert  to  the  significance  of  negative  evidence. 

If  there  was  one  main  characteristic  problem  of  theorizing  among 
the  sampled  naval  analysts  it  was  perhaps  the  reluctance  to  make  specific 
predictions  on  the  basis  of  various  theories  and  to  systematically  and 
repeatedly  test  theories  against  one  another.  In  particular,  there  was 
too  little  explicit  disconfirmation  and  too  much  confirmation.  There  was 
very  little  effort  devoted  to  developing  methods  of  testing  theories  which 
would  reflect  quantitatively  the  degree  to  which  evidence  supports  or  does 
not  support  an  hypothesis.  Although  we  found  naval  analysts  updated  their 
theories,  the  lack  of  explicit  methods  tor  evaluating  the  degree  of 
support  that  evidence  conveys  on  a  given  hypotheses  made  it  difficult  to 
ascertain  exactly  wh£  the  analyst  changed  ihe  theory. 

Although  there  are  aids  available  to  analysts  which  quantify 
hypothesis  testing  (e.g  ,  Bayes  Theorem  is  specifically  formulated  to 
update  a  prior  hypothesis  given  new  information),  there  are  no 
quantitative  aids  that  prescribe  how  or  when  scientists  should  reformulate 
theories.  As  Kuhn  (1970)  describes  the  structure  of  scientific 
revolutions,  the  process  is  largely  a  social  one  of  scientists  arguing, 
replicating,  confirming,  revising,  and  generally  shaping  and  influencing 
each  other's  views  and  research.  Scientific  discoveries  which  rail  to 
generate  interest  in  other  scientists  die  on  the  vine  unless  rediscovered 
in  the  wake  of  a  scientific  crisis  and  revolution.  Similarly,  an 
intelligence  or  naval  analyst  may  reformulate  a  theory  of  intentions  that 
produces  better  estimates,  but  unless  the  new  theory  is  communicated  to 
other  analysts  and  to  estimate  users,  it  is  likely  to  have  very  little 
impact,  except  on  its  originator.  Furthermore,  it  is  likely  that  the 
insights  of  one  analyst  are  significantly  sharpened  and  refined  when  they 
are  shared  with  and  examined  by  others,  A  theory  developed  in  a  community 
of  analysts  is  likely  to  be  better  than  the  same  theory  developed  only  by 
its  originator. 

This  suggests  that  there  are  important  social  and  organizational 
dimensions  to  theory  formulation,  revision,  and  change  and  that  aiding 
these  dimensions  of  estimation  goes  beyond  the  individual  analyst  (see 
Steeh,  1979,  for  an  appraisal  of  social,  organizational ,  and  political 
aspects  of  intention  estimation).  Just  as  there  are  weaknesses  in 
estimation  logic,  there  are  weaknesses  in  the  organisational  processes  of 
estimation.  These  social  and  organisational  dimensions  become  important 
wueu  the  analyst  developing  a  new  theoretical  outlook  that 
conflicts  with  or  goes  beyond  the  normal,  accepted  theory,  i»e.,  when  the 
analyst's  new  theory  conflicts  with  other  analyses'  theories. 

Host  of  the  advice  given  in  this  chapter  involves  greater 
precision  of  hypotheses,  greater  specification  of  variables  and 
relatJ unships,  more  use  of  mathematical  and  psychological  techniques  to 
ascertain  and  refine  variables  and  relationships,  and  greater  willingness 
fee  predict  and  cheek  predictions.  All  o I  this  advice  amounts  to  saying 
that  naval  analysts  might  do  intention  estimation  more  like  scientists  do 
science.  Quantification,  measurement,  specificity  and  precision,  and 
prediction  are  means  and  ends  of  the  sclent i tic  method,  Qnce  the  analyst 
resolves  to  be  scientific  and  to  use  the  methods  and  tools  of  science,  he 
or  she  can  find  8  large  literature  of  helpful  and  useful  advice  on  theory 
building  and  testing,  scientific  settled,  epistemology  and  the  philosophy 
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of  science  mid  scientific  theory.  There  is  no  point  attempting  to  review 
the  pathways  into  that  literature  here,  any  reader  who  avails  himself  of 
the  references  in  this  study  will  quickly  find  many  leads  if  such  are 
needed. 

A  more  important  issue  is  whether  and  to  what  degree  scientific 
methods  are  appropriate  for  the  social,  political,  and  naval  science 
questions  that  concern  the  naval  analyst.  Science  requires,  in  addition 
to  the  attributes  noted  above,  coatrol  and  experimental  manipulation  of 
variables.  Control  and  experimentation  are  rareiy  possible  in  the  **>."Aal 
sciences  to  the  degree  that  they  can  be  exercised  in  physical  es. 
Does  this  mean  that  the  social  sciences  cannot  be  truly  scientific  and 
that  attempts  at  scientific  methods  in  these  areas  are  fated  to  be  little 
more  than  over-sophistication? 

No  clear-cut,  general  prescriptions  can  be  offered  to  the  analyst 
on  this  issue.  It  will  be  up  to  the  analyst  whether  to  adopt  a  scientific 
or  quantitative  technique,  to  atteaipt  explicit  theorizing  and  theory 
building,  or  to  continue  to  rely  on  narrative  explanation.  Scientists  and 
philosophers  continue  to  wrestle  with  the  question  of  whether  social 
science  can  be  trul>  scientific  (e.g  ,  see  McClintock,  1981;  Ximan,  1979). 
Just  as  unaided  analysis  and  theory-building  have  their  limitations,  as  we 
outlined  in  Chapter  A,  scientific  methods  and  theories  have  their  limits, 
especially  as  applied  to  social  phenomena.  Naval  analysts  should  be  aware 
of  the  limits  of  both. 

Whether  a  particular  quantitative  aid  or  theory-building  approach 
will  be  useful  or  helpful  is  largely  an  empirical  question.  We  have  tried 
to  outline  how  the  naval  analyst  can  detect  and  assess  the  shortcomings  of 
his  or  her  unaided  estimation  or  narrative  logic.  The  analyst  will  have 
to  apply  this  general  knowledge  to  the  particular  ease  to  determine 
whether  the  shortcomings  thus  detected  are  serians  enough  to  warrant  the 
use  of  explicit  quantitative  aids.  Similarly,  the  analyst  will  have  to 
evaluate  the  advantages  against  the  costs  of  developing  a  quantitative 
theory-building  approach,  the  use  of  multiple  hypothesis  disconfirmation 
strategies,  or  the  other  theory-revision  methods  noted  in  tnaptcr  A,  and 
in  the  previous  sections  of  this  chapter# 

In  effect,  the  analyst  faces  an  infinite  regress:  how  to  decide 
whether  or  not  to  try  out  a  particular  method  or  theory-building  approach? 
If  decision-aiding  methods  or  Judgment-enhancing  approaches  are 
recommended  to  help  with  this  first  question,  the  analyst  is  faced  with 
the  second  question:  how  to  decide  whether  an  aided  decision  is  better 
than  an  unaided  one? 

While  it  it  a  basic  finding  of  this  study  that  unaided  estimation 
tends  to  be  inferior  to  estimates  that  explicitly  employ  aids  to 
information  organisation,  integration,  and  inference,  in  general  we  cannot 
draw  hard  conclusions  about  how  inferior  unaided  estimation  night  be. 
This  sake*  the  question  of  tW“e©se«  and  benefits  of  aided  versus  unaided 
estimation  and  tfteory-boil ’lag  an  eupirical  one  and  one  tor  which  the 
analyst  wight  want  to  o-t  decision-aiding  or  judgment -aiding 
expertise,  particularly  if  the  costs  and  risks  involved  are  very  high# 

The  approach  taken  by  a'beary  and  Sop! in  {!$?$)  seems  an  estimable 
one  worth  repeating  Cal  though  perhaps  with  a  wore  systematic  appraisal 
methodology).  They  compared  the  qualitative  analyses  and  forecasts  of 
unaided  State  Department  intelligence  analysts  to  estimations  based  on 
quantitative  approaches  to  the  sane  intelligence  issues.  They  also 


evaluated  the  costs  and  benefits  of  the  quantitative  methods.  O'Leary  and 
Coplin  made  an  informal  cost-benefit  analysis,  and  it  might  be  necessary 
for  naval  analysts  to  make  such  evaluations  more  explicitly  and 
systematically  (e.g.,  using  cost-benefit  techniques,  decision-analysis, 
multiattribute  utility  methods,  etc.)  or  to  attempt  a  prospective  rather 
than  a  retrospective  evaluation.  The  main  point,  however,  is  that  the 
quantitative  methods  were  tried  to  see  if  they  work,  with  what  limits,  to 
determine  how  much  improvement  they  could  make,  and  at  what  expense.  This 
is  an  approach  we  would  recommend  to  any  analyst  who  might  be  tempted  to 
try  an  improved  methodology  for  intention  estimation. 

Theory  and  Naval  Analysis  ;  An  F.udnote 

For  many  centuries  scurvy  was  the  greatest  killer  of  seamen,  worse 
than  war,  accidents,  storms,  or  all  other  causes  of  death  together. 
Hosteller  (1981)  recently  summarized  the  course  of  the  medical  theorizing 
and  research  on  this  terrible  naval  scourage.  The  first  clues  as  to 
scurvy's  causes  came  wheu  James  Lancaster  sailed  with  four  ships  to  India 
for  the  British  Fast  India  Company.  Lancaster  dosed  the  crew  of  one  of 
the  four  ships  with  three  teaspoons  of  lemon  juice  each  day.  Few  of  the 
men  on  this  ship  died,  but  more  than  a  third  of  the  men  died  on  the  other 
three  ships, 

James  Lind,  a  physician,  learned  of  Lancaster's  experience  and 
conducted  another  experiment  ou  the  ship  Salisbury.  He  gave  sailors  with 
scurvy  one  of  the  following  six  treatments:  vinegar,  sea  water,  cider, 
vitriol  elixir,  oranges  and  lemons,  oc  nutmeg.  Those  patients  who 
received  the  citrus  recovered,  the  rest  did  not. 

The  British  Navy  began  using  citrus  juice  on  a  regular  basis  and 
scurvy  was  wiped  out  in  the  fleet.  The  British  Board  of  Trade  followed 
the  Navy  end  scurvy  was  eliminated  from  the  merchant  service* 

Hosteller's  tale  of  theory  being  put  to  practical  use  for  naval 
service  is  an  admirable  case  of  naval  analytic  theorising,  save  in  one 
feature,  Lancaster's  discovery  was  made  in  1401,  Lind's  experiment  was 
conducted  in  1?4?,  the  British  Navy  adopted  lemon  juice  in  l?9i,  and  the 
Board  of  trade  did  the  same  in  186$,  As  Hosteller  Cp»  884)  noted,  even 
today,  4 (JO  years  after  scurvy  was  identified  m  a  naval  plague,  the  W.&. 
Navy  is  concerned  with  the  law  levels  of  vitamin  C  in  the  plasma  of 
submariners  after  petrols* 

Theory  is  a  powerful  tool  for  naval  analysis,  if  difficult  at 
times  to  apply* 
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APPENDIX 


HISTORICAL  FALLACIES* 


1.  Inquiry 

A*  Question  ~  Framing 

l*  Laconian  Fallacy  - 

2.  Many  Questions 

3*  False  Dichotomies  - 

4,  Metaphysical  Questions  - 

%•  Fictional  Questions  - 
b.  Semantical  Questions  - 
7»  Declarative  Questions  - 

S»  Counterquestions  ** 

9»  Tautological  Questions  - 

10*  Ceil “contradictory 

Questions 

&.  Factual  verification 
ll>  PseudO“pfooi  “ 

It*  Irrelevant  Proof  ** 

13*  Fro of  %>*  Absence  - 

*Su£atta'ty  "of  Fischer  (1970). 


pure  Induction  and  synthesis,  no 
preconceptions 

(a)  requiring  two  answers  and 
allowing  only  one 

(b)  begging  the  question 

(c)  tankin'*  a  false  premise 

(d)  demanding  a  simple  answer  for  a 
complex  question 

assuming  cither/or  and  ruling  out 
amt/both;  assuming  mutual 
exclusion  and  collective 
exhaustion 

demanding  empirical  answers  for 
metaphysical  questions 

"what  if“  speculative  questions 

confusion  of  names  with  events 

questions  which  state  their  own 
answers 

posing  a  question  as  an  answer 

all  possible  answers  are  true,  by 
definition 


all  possible  answers  are  false 


falsely  precise  and  specific 
statements  of  no  real  meaning 


facts  of  no  bearing  on  the  question 

no  evidence  for  X  taken  as  evidence 
for  ttotrX 


14.  Presumptive  Proof  - 

15.  Circular  Proof  - 

16.  Mass  Opinion  Proof  - 

17.  Possible  Proof  - 

18.  Hypostatized  Proof  - 

19.  Appositive  Proof  - 

20.  Misplaced  Lite  ilisrn  - 

21.  Misplaced  Precision  ** 

Factual  Significance 

22.  Holism  - 

23»  Essences  - 

24*  Prodigious  Facts  - 
2S*  Furtive  Facts  - 

2 6.  Moralistic  Facts  - 

27.  Pragmatic  Facts  « 

28.  Aesthetic  Facts  “ 

29-  Quantitative  Facts  - 
3d.  Antiuooian  Facts  - 

31.  Fortuitous  Facts  ~ 


shifting  burden  of  proof  onto  others 

assuming  what  was  to  bo  demonstrated 

amassing  expert  opinions  on  Issues, 
rather  thau  proof 

showing  that  X  is  possible,  rather 
than  'that  X  is  true 

accepting  a  theory  of  X  as  proof  of  X 
itself 

proving  A  by  contrast,  to  B,  where  B 
is  in  error 

assuming  everything  said  is  literally 
meant 

accepting  more  accuracy  thau  is 
possible 


a  sense  of  the  whole  must  guide 
selection  of  details 

the  “inner  core  of  reality*  must  be 
sought  and  gives  certainty  and 

completeness  to  facts 

sensational  facts  are  mistaken  lor 
ttignif leant  facts 

secret  facts  are  assumed  to  have  more 
truth  or  significance 

morally  ©Hiving  events  assumed  to  he 
of  greater  significance 

facts  that  are  useful  for  a  social 
cause  assumed  also  to  be  more 
significant 

elegant  fa^ts  believed  to  be  sore 
probative 

facts  which  count  best  count  lost 

facts  count  tost  which  count  least. 
CotoitRcnt  to  uniqueness 

infestation  uncovered  by  accident  or 
at  the  time  deewed  to 

be  of  greater  significance 


•w  .  J  i'HUBI 


»*P!S 


II •  Explanation 

A.  Generalization 

32.  Insufficient  Sampling  ~ 

33.  Lonely  Facts  - 

34.  Special  Pleading  - 

35*  Statistical 

Itapressionism  - 

36.  Statistical  Nonsense  - 

37.  Probability  Fallacies  - 

3Q*  Ecological  Fallacy  - 

39.  Falsa  Extrapolation  - 

40.  False  Interpolation  - 

41*  Insidious 

Generalisations  - 


42.  bauble-reversing 

Generalisation  - 


43.  the  Overwhelming 

Except ion  * 


conclusions  based  on  too-soall 
bumples 

generalization  from  a  single  case 

use  of  ;t  double  standard  of  evidence 
interpretation  to  deal  with  in¬ 
convenient  data,  e.g..  rejecting 
“out  Hers  “ 

impressionistic  interpretations  of 
precise  numbers,  or  casting 
impressions  into  precise  numbers 

a  generalization  with  no  meaning  for 
the  case  in  the  present  context 

(a)  assuming  a  distribution  will  bo 
exactly  repeated 

(b)  gambler’s  fallacy  -  assuming 

a  random  event  is  overdue  to  e<w*mr 

aeasurewont  classes  do  t  : 
with  she  variable  being 
measured 

stretching  a  statistical  series  past 
the  breaking  point 

ef  interpolation  assumed 
greater  than  the  accuracy  of 
its  weakest  end  points 


bootlegging  in  generalisations 
despite  disclaimer*  via  hedge 
word* 5  few*  *sany*  te@e»  nnr«*a.l# 
often  etc*  *  without 
using  any  numerical  evidence 

a  Hatting  generalisation. 
end£8f«i£te«efti  of  generality 
interpretive  bet-hedging 


A  general isat isa  based  on  an  a- 
typlcai  cave,  or  the  gensraii- 
iatioo  that  ignores  major 


1 
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exceptions 


B,  Narration 

44,  Anachronisms  -  taking  concepts  out  of  their  right 

time 

45*  Presontism  (nunc 

pro  tunc)  -  the  outcomes  explain  the  means;  the 
significance  ot  antecedents 
determined  by  their  consequences 

46,  Antiquaria  ‘^s®  -  opposite  of  pr-ssene is®,  collection  of 

dead  facts,  well  preserved  fro® 
the  present 

47,  Tunnel  History  -  sealing  off  a  class  of  events  fro® 

everything  else  that  lias 
happened 

45,  false  Puriodication  *  applying  inappropriate  temporal 

limits  to  a  problem,  false 
application  of  a  time  scheme 
from  one  realm  to  another 

4S,  Telescoping  «  making  a  long  story  too  short, 

reducing  a  trend  to  a 
transformation  ' 

SO*  intormlnalism  -  making  a  short  story  too  long,  or  a 

long  story  longer.  A  false 
extrapolation  stretched  past 
the  breaking  point 

Si,  Archetypes  •  tmtcc  "'tuaiiaing  ehangts  in  fere#  of 

■pkitwMai  arrhetyfes.  As^ueing 
H.m  it  sspeatisg  itself 
exactly : 

53,  Chronic  ChroMea  *»  ■  *i®pl#e@d  teap@?#i  eva*- 

rigid  ehsonologigai  sequtM@» 

tc  i  U  fig  everything  in  its  temporal 
order 

55,  Static  fallacy  “  ce«g§ptoasii*4«g  a. dynamic  pfg&itst  as 

a  Staff e  git# .  Thfe  nst  ion  Of 

emergence  or  unfolding  of  a  static 
plan 

54,  Presumptive  Continuity 

and  Change  '•*•  assuming  change  of  con- 

tinulty  require  no  explanations 

55,  Celtic  Pal  lacy  -  *i*tefciO£  a  description  of  process 

for  on  a&alytieal  explanation 


20b 


J, 5W? ||..i.<»w.»^r.,py. j1''*  ^ '  r* 


56.  Didactic  Fallacy  -  attempting  to  extract  lessons  of 

history  and  applying  thoo  to 
Lite  present 


C.  Causality 

5?.  Fosc  Hoc,  Propter  hoc  - 

56.  Cue*  Hoc,  Propter  Hoc  ~ 
5*).  Pro  Hoc,  Propter  Uoc  - 

60.  deduct  ionise*  ~ 

61.  Identity  * 

62.  Absolute  priority  "* 

65.  indiscriminate 

f*luraii$ss  * 

.  o4,  Ikshsttisfic  Cause-;  “ 
.St*  '3»  Saua»$  « 

66.  IteSfH&ss i fei ii ty  s# 

•':'..;:v.:.;'.V,  o&zm. *'■*- 

51*.  . 

6d<  Apathetic  Solises? ■».' 

«  IdgnUta  *  ;■■■ 


20/ 


if  !s  toJ*ow«d  A,  A  caused  li,  big 
events  have  big  results 

assuming  eor relation  equals  causation 

putting  the  effect  before  tins  causes 

reducing  complexity  ta  simplicity,  or 
diversity  t«  uni  fortuity.  Catt“ 
fusion  of  necessary  with 
sufficient  causes 

assumption  that  causes  oust  resemble 
their  effects,  e.g,,  big  events 
Have  big  causes,  economic 
events  have  economic  causes,  etc 

belief  in  an  absolute  first  tore*  in 
a  series  of  causes 


multiple  causes  postulated,  of 
ift’iete?a*inata-  number  and 
eights 

An  %i*a«  are  additive 

tasiter  th3&  inwt&sU&it 

a  reason  far  an  event  assumed  to  k 
tW  cause  of  tlwf  event 


apney  vitf*  «3y#$ti£y 
mmkvm  Sftta  *tid  itw  raiiter 
titan  ’Hsw  did  it  happen" 


asatiytl&u  g$  snfafette  teliaels#  to 
obiirci#,  ,fen#r^iiai«g 
fs$  flumps  fr«3#  individuaiiS 

.M&UeslUjl  ts&sels^vif it  <rife»tfast##SssSi*sd 
for  acs®rs.  fienyfng. 

t  realist^  3de»».iogi«* 
a#  pathologies 

Ovvt'CO<t4at.'is  do  fcmtSfledge  and 


70.  Ottc-diacas  lotted 

Motives  « 


71#  Universal  Motives  - 


72.  Maas,  i .ocxves  - 


73.  Man-mass  Motives  ** 


74,  historian's  Fallacy  ** 


E,  Composition 

73,  Composition  Fallacy  - 


76.  Division  Fallacy  - 
77 *  Differences  ~ 


29.  EthfiOaorpMs®  - 

&ii.  fi£h&C££Mt’ls3l  - 

SI,  SUtisa  - 

62.  fcciws  - 

83.  Ctoas-grottping  - 


calculation  in  conduct,  and 
underestimation  os'  other  motives 


single  motive  explanations,  e  g. 
power 

assumption  that  people  are 
intellectually  and 
psychologically  identical 

ascribing  motivations  beyond  those  of 
individuals  to  groups 

taking  an  individual  and  enlarging 
them  into  a  group 

assuming  that  subjects  of  history 
haws  insights  into  their 
situations  that  historians 
have  with  hindsight 
Assuming  that  people  can  know 
what  is  coming  next 


generalising  a  property  of  an 
individual  to  a  group,  false 
extrapolation 

application  of  group  qualities  to  all 
members 

conceptual  laing  a  p®«p  In  te?m§  sf 
its  spstinl  rather  than  its  genetic 
ekarneter  1st  iun 

tendering  a  special  judgmvftt  on  i 
gtonp  for  a  fch&rsssetiitle  which  is 
nut  special  to  it 

fi4*f6fmi*#|46g*  feuneeftuaiising 
anether  group  in  t®t«s  of  character 
istics  «t  one's  own  group 

exaggerating  the  r$lt  §§  §m§  gmu^  in 

it§  i«t:sr*c£ ion*  with  ether 

groups 

concept  af  4  group  in  t«vU*  Of  its 
upper  strata 

confusion  of  genetics  and  culture 
u «t«g  terms  of  Ode  group  to  con- 
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